Feb 27 01:56:02 devstack cinder-volume[72850]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 01:56:02 devstack cinder-volume[72850]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 01:56:02 devstack cinder-volume[72850]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 01:56:03 devstack cinder-volume[72850]: INFO dbcounter [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Registered counter for database cinder Feb 27 01:56:03 devstack cinder-volume[72850]: DEBUG oslo_db.sqlalchemy.engines [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72850) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:56:03 devstack cinder-volume[72850]: DEBUG dbcounter [-] [72850] Writer thread running {{(pid=72850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 01:56:03 devstack cinder-volume[72850]: INFO cinder.rpc [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 01:56:03 devstack cinder-volume[72850]: INFO cinder.rpc [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 01:56:03 devstack cinder-volume[72850]: DEBUG oslo_db.sqlalchemy.engines [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72850) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:56:03 devstack cinder-volume[72850]: INFO cinder.volume.manager [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Determined volume DB was empty at startup. Feb 27 01:56:03 devstack cinder-volume[72850]: DEBUG cinder.volume.manager [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72850) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 27 01:56:03 devstack cinder-volume[72850]: INFO cinder.volume.manager [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 27 01:56:03 devstack cinder-volume[72850]: WARNING stevedore.named [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 01:56:03 devstack cinder-volume[72850]: WARNING castellan.key_manager [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 01:56:03 devstack cinder-volume[72850]: WARNING cinder.keymgr.conf_key_mgr [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 01:56:03 devstack cinder-volume[72850]: DEBUG cinder.volume.drivers.lvm [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72850) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Feb 27 01:56:03 devstack cinder-volume[72850]: DEBUG oslo_concurrency.processutils [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_concurrency.processutils [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] CMD "cinder-rtstool verify" returned: 0 in 0.221s {{(pid=72850) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_db.sqlalchemy.engines [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72850) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:56:04 devstack cinder-volume[72850]: INFO cinder.rpc [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Feb 27 01:56:04 devstack cinder-volume[72850]: INFO cinder.rpc [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Feb 27 01:56:04 devstack cinder-volume[72850]: WARNING stevedore.named [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 01:56:04 devstack cinder-volume[72850]: WARNING castellan.key_manager [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 01:56:04 devstack cinder-volume[72850]: INFO cinder.volume.manager [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Image-volume cache enabled for host devstack@lvmdriver-1. Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_db.sqlalchemy.engines [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72850) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:56:04 devstack cinder-volume[72850]: INFO oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Starting 1 workers Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Started child 72987 {{(pid=72850) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Full set of CONF: {{(pid=72850) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] ******************************************************************************** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Configuration options gathered from: {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] ================================================================================ {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] allow_availability_zone_fallback = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] allow_compression_on_image_upload = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72987]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] allowed_direct_url_schemes = [] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] api_rate_limit = True {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] auth_strategy = keystone {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] az_cache_duration = 3600 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_availability_zone = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_host = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_name = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_stats_polling_interval = 60 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backup_api_class = cinder.backup.api.API {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backup_name_template = backup-%s {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backup_use_same_host = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backup_use_temp_snapshot = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] chap_password = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] chap_username = {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cinder_internal_tenant_project_id = 35c5795673c140c6af16eb2d458d5e62 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cinder_internal_tenant_user_id = 9a444f56fad2404ba1d37bf0852dbcf5 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cloned_volume_same_az = True {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cluster = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] compression_format = gzip {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] compute_api_class = cinder.compute.nova.API {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] config_dir = [] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] config_source = [] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] control_exchange = openstack {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] debug = True {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] default_availability_zone = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] default_group_type = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] default_volume_type = lvmdriver-1 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] disk_geometry = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] driver_client_cert = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] driver_client_cert_key = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] driver_data_namespace = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] driver_ssl_cert_path = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] driver_ssl_cert_verify = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] driver_use_ssl = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] enable_force_upload = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] enable_new_services = True {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] enable_unsupported_driver = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] enabled_backends = ['lvmdriver-1'] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] enforce_multipath_for_image_xfer = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] filter_function = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] glance_api_insecure = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] glance_api_servers = ['http://192.168.122.79/image'] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] glance_api_ssl_compression = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] glance_ca_certificates_file = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] glance_catalog_info = image:glance:publicURL {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] glance_certfile = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] glance_keyfile = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] glance_num_retries = 3 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] glance_request_timeout = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] goodness_function = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] graceful_shutdown_timeout = 5 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] group_api_class = cinder.group.api.API {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] host = devstack {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] image_compress_on_upload = True {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] image_conversion_address_space_limit = 1 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] image_conversion_cpu_limit = 60 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] image_conversion_disable = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] image_upload_use_cinder_backend = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] image_upload_use_internal_tenant = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] image_volume_cache_enabled = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] image_volume_cache_max_count = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] image_volume_cache_max_size_gb = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] init_host_max_objects_retrieval = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] instance_format = [instance: %(uuid)s] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] iscsi_target_flags = {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] iscsi_write_cache = on {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] iser_helper = tgtadm {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] iser_ip_address = 192.168.122.79 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] iser_port = 3260 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] log_color = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] log_config_append = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] log_dir = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] log_file = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] log_options = True {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] log_rotate_interval = 1 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] log_rotate_interval_type = days {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] log_rotation_type = none {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] max_age = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] max_logfile_count = 30 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] max_logfile_size_mb = 200 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] max_over_subscription_ratio = 20.0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] message_reap_interval = 86400 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] message_ttl = 2592000 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] migration_create_volume_timeout_secs = 300 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] monkey_patch = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] monkey_patch_modules = [] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] my_ip = 192.168.122.79 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] no_snapshot_gb_quota = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] num_iser_scan_tries = 3 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] num_shell_tries = 3 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] num_volume_device_scan_tries = 3 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] nvmeof_conn_info_version = 1 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] nvmet_ns_id = 10 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] nvmet_port_id = 1 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] osapi_max_limit = 1000 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] osapi_volume_ext_list = [] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] osapi_volume_listen = 0.0.0.0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] osapi_volume_listen_port = 8776 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] osapi_volume_use_ssl = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] osapi_volume_workers = 2 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] per_volume_size_limit = -1 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] periodic_fuzzy_delay = 60 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] periodic_interval = 60 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] project_id_regex = [0-9a-f\-]+ {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] public_endpoint = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] publish_errors = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] quota_backup_gigabytes = 1000 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] quota_backups = 10 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] quota_gigabytes = 1000 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] quota_groups = 10 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] quota_snapshots = 10 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] quota_volumes = 10 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] rate_limit_burst = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] rate_limit_except_level = CRITICAL {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] rate_limit_interval = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] reinit_driver_count = 3 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] replication_device = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] report_discard_supported = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] report_interval = 120 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] reservation_clean_interval = 86400 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] reservation_expire = 86400 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] reserved_image_namespaces = [] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] reserved_percentage = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] rpc_response_timeout = 120 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] run_external_periodic_tasks = True {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] scst_target_driver = iscsi {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] scst_target_iqn_name = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] service_down_time = 720 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] shell_completion = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] snapshot_name_template = snapshot-%s {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] snapshot_same_host = True {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] split_loggers = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] state_path = /opt/stack/data/cinder {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] storage_availability_zone = nova {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] storage_protocol = iSCSI {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] syslog_log_facility = LOG_USER {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] target_helper = lioadm {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] target_ip_address = 192.168.122.79 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] target_port = 3260 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] target_protocol = iscsi {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] target_secondary_ip_addresses = [] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] trace_flags = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] transfer_api_class = cinder.transfer.api.API {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] transport_url = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] until_refresh = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] use_chap_auth = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] use_default_quota_class = True {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] use_journal = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] use_json = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] use_multipath_for_image_xfer = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] use_stderr = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] use_syslog = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] verify_glance_signatures = enabled {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] volume_api_class = cinder.volume.api.API {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] volume_backend_name = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] volume_clear = zero {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] volume_clear_ionice = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] volume_clear_size = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] volume_copy_bps_limit = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] volume_dd_blocksize = 1M {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] volume_name_template = volume-%s {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] volume_service_inithost_offload = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] volume_usage_audit_period = month {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] zoning_mode = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_concurrency.disable_process_locking = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.admin_password = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.admin_token = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.admin_user = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.auth_admin_prefix = {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.auth_port = 35357 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.auth_protocol = https {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.auth_section = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.auth_type = password {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.auth_uri = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.auth_version = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.cache = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.certfile = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.delay_auth_decision = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.http_connect_timeout = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.identity_uri = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.include_service_catalog = True {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.insecure = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.interface = public {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.keyfile = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.memcache_password = {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.memcache_username = {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.region_name = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.service_token_roles_required = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.service_type = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.token_cache_time = 300 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.79/identity {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.backend = dogpile.cache.null {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.backend_argument = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.backend_expiration_time = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.config_prefix = cache.oslo {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.debug_cache_backend = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.enable_retry_client = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.enable_socket_keepalive = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.enabled = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.enforce_fips_mode = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.expiration_time = 600 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.hashclient_retry_attempts = 2 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.memcache_dead_retry = 300 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.memcache_pool_maxsize = 10 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.memcache_sasl_enabled = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.password = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.proxies = [] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.redis_db = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.redis_sentinel_service_name = mymaster {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.redis_server = localhost:6379 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.retry_attempts = 2 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.retry_delay = 0.0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.socket_keepalive_count = 1 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.socket_keepalive_idle = 1 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.socket_keepalive_interval = 1 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.socket_timeout = 1.0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.tls_allowed_ciphers = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.tls_cafile = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.tls_certfile = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.tls_enabled = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.tls_keyfile = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cache.username = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] coordination.backend_url = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.asyncio_connection = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.asyncio_slave_connection = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.backend = sqlalchemy {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.connection = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.connection_debug = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.connection_parameters = {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.connection_recycle_time = 3600 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.connection_trace = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.db_inc_retry_interval = True {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.db_max_retries = 20 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.db_max_retry_interval = 10 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.db_retry_interval = 1 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.max_overflow = 50 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.max_pool_size = 5 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.max_retries = 10 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.mysql_wsrep_sync_wait = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.pool_timeout = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.retry_interval = 10 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.slave_connection = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.sqlite_synchronous = True {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.synchronous_reader = True {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] database.use_db_reconnect = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] profiler.connection_string = messaging:// {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] profiler.enabled = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] profiler.es_doc_type = notification {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] profiler.es_scroll_size = 10000 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] profiler.es_scroll_time = 2m {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] profiler.filter_error_trace = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] profiler.hmac_keys = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] profiler.sentinel_service_name = mymaster {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] profiler.socket_timeout = 0.1 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] profiler.trace_requests = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] profiler.trace_sqlalchemy = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] profiler_jaeger.process_tags = {} {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] profiler_jaeger.service_name_prefix = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] profiler_otlp.service_name_prefix = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_policy.enforce_new_defaults = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: WARNING oslo_config.cfg [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_policy.enforce_scope = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_policy.policy_default_rule = default {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_policy.policy_file = policy.yaml {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_policy.remote_timeout = 60.0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] privsep_osbrick.group = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] privsep_osbrick.helper_command = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] privsep_osbrick.user = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cinder_sys_admin.group = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cinder_sys_admin.helper_command = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] cinder_sys_admin.user = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] service_user.auth_section = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] service_user.auth_type = password {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] service_user.cafile = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] service_user.certfile = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] service_user.collect_timing = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] service_user.insecure = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] service_user.keyfile = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] service_user.send_service_user_token = True {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] service_user.split_loggers = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] service_user.timeout = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] glance.auth_section = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] glance.auth_type = password {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] glance.certfile = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] glance.collect_timing = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] glance.insecure = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] glance.keyfile = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] glance.region_name = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] glance.split_loggers = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] glance.timeout = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.backend_availability_zone = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.chap_password = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.chap_username = {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.disk_geometry = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.driver_client_cert = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.driver_client_cert_key = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.driver_data_namespace = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.driver_use_ssl = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.enable_unsupported_driver = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.extra_capabilities = {} {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.filter_function = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.goodness_function = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.iscsi_target_flags = {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.iscsi_write_cache = on {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.iser_helper = tgtadm {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.iser_ip_address = 192.168.122.79 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.iser_port = 3260 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.lvm_mirrors = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.lvm_share_target = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.lvm_type = auto {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.num_shell_tries = 3 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.nvmet_port_id = 1 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.replication_device = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.report_discard_supported = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.reserved_percentage = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.scst_target_driver = iscsi {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.scst_target_iqn_name = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.storage_protocol = iSCSI {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.target_helper = tgtadm {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72987]: INFO cinder.volume.manager [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Starting volume driver LVMVolumeDriver (3.0.0) Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.target_ip_address = 192.168.122.79 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.target_port = 3260 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.target_protocol = iscsi {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.trace_flags = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.unique_fqdn_network = True {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.use_chap_auth = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.volume_backend_name = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.volume_clear = zero {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.volume_clear_ionice = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.volume_clear_size = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.volume_group = cinder-volumes {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_reports.file_event_handler = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_reports.log_dir = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.backend_availability_zone = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.backend_host = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.chap_password = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.chap_username = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.chiscsi_conf = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.disk_geometry = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.driver_client_cert = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.driver_data_namespace = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.driver_use_ssl = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.extra_capabilities = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.filter_function = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.goodness_function = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.iser_helper = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.iser_ip_address = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.iser_port = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.iser_target_prefix = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.lvm_conf_file = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.lvm_mirrors = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.lvm_share_target = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.lvm_type = auto {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.num_shell_tries = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.nvmet_port_id = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.replication_device = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.report_discard_supported = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.reserved_percentage = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.scst_target_driver = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.storage_protocol = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.target_helper = lioadm {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.target_ip_address = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.target_port = 3260 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.target_protocol = iscsi {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.trace_flags = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.use_chap_auth = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.volume_clear = zero {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.volume_clear_size = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] lvmdriver-1.volumes_dir = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.ssl = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.ssl_version = {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_notifications.driver = [] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_notifications.retry = -1 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] oslo_messaging_notifications.transport_url = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] key_manager.fixed_key = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican.barbican_api_version = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican.barbican_endpoint = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican.barbican_endpoint_type = public {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican.barbican_region_name = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican.cafile = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican.certfile = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican.collect_timing = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican.insecure = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican.keyfile = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican.number_of_retries = 60 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican.retry_delay = 1 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican.send_service_user_token = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican.split_loggers = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican.timeout = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican.verify_ssl = True {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican.verify_ssl_path = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican_service_user.auth_section = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican_service_user.auth_type = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican_service_user.cafile = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican_service_user.certfile = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican_service_user.collect_timing = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican_service_user.insecure = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican_service_user.keyfile = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican_service_user.split_loggers = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] barbican_service_user.timeout = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] vault.approle_role_id = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] vault.approle_secret_id = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] vault.kv_mountpoint = secret {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] vault.kv_path = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] vault.kv_version = 2 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] vault.namespace = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] vault.root_token_id = **** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] vault.ssl_ca_crt_file = None {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] vault.timeout = 60.0 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] vault.use_ssl = False {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 01:56:04 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] ******************************************************************************** {{(pid=72850) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 01:56:04 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.056s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:04 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:04 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:04 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:04 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:04 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:04 devstack sudo[72991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Feb 27 01:56:04 devstack sudo[72991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:04 devstack sudo[72991]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:04 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.531s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:04 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:04 devstack sudo[73182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:04 devstack sudo[73182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:05 devstack sudo[73182]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:05 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.546s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:05 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 01:56:05 devstack cinder-volume[72987]: INFO cinder.brick.local_dev.lvm [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Feb 27 01:56:05 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:05 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:05 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:05 devstack sudo[73385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:56:05 devstack sudo[73385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:06 devstack sudo[73385]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:06 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:06 devstack cinder-volume[72987]: DEBUG cinder.brick.local_dev.lvm [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72987) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Feb 27 01:56:06 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:06 devstack sudo[73510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:06 devstack sudo[73510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:06 devstack sudo[73510]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:06 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.881s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:06 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:06 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:06 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:06 devstack sudo[73668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:06 devstack sudo[73668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:07 devstack sudo[73668]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:07 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.523s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:07 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:07 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:07 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:07 devstack sudo[73680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Feb 27 01:56:07 devstack sudo[73680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:07 devstack sudo[73680]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:07 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.453s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:07 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:07 devstack sudo[73690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:56:07 devstack sudo[73690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:08 devstack sudo[73690]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:08 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:08 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:08 devstack sudo[73695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:56:08 devstack sudo[73695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:08 devstack sudo[73695]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:08 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.491s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:08 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:08 devstack sudo[73698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:56:08 devstack sudo[73698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:09 devstack sudo[73698]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:09 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.547s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:09 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:09 devstack sudo[73706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:09 devstack sudo[73706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:09 devstack sudo[73706]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:09 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.501s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:09 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:10 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:10 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:10 devstack sudo[73710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:10 devstack sudo[73710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:10 devstack sudo[73710]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:10 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.630s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:10 devstack cinder-volume[72987]: INFO cinder.volume.drivers.lvm [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Enabling LVM thin provisioning by default because a thin pool exists. Feb 27 01:56:10 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:10 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.012s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:10 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:10 devstack sudo[73828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:10 devstack sudo[73828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:11 devstack sudo[73828]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:11 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.485s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:11 devstack cinder-volume[72987]: DEBUG cinder.volume.drivers.lvm [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Updating volume stats {{(pid=72987) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:56:11 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:11 devstack sudo[73831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:56:11 devstack sudo[73831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:11 devstack sudo[73831]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:11 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:11 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:11 devstack sudo[73972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:56:11 devstack sudo[73972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:12 devstack sudo[73972]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:12 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.467s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:12 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:12 devstack sudo[73975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:12 devstack sudo[73975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:12 devstack sudo[73975]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:12 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.492s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:12 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:12 devstack sudo[73979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:56:12 devstack sudo[73979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:13 devstack sudo[73979]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:13 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.518s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:13 devstack cinder-volume[72987]: INFO cinder.volume.driver [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Driver hasn't implemented _init_vendor_properties() Feb 27 01:56:13 devstack cinder-volume[72987]: DEBUG cinder.volume.driver [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72987) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 01:56:13 devstack cinder-volume[72987]: DEBUG oslo_db.sqlalchemy.engines [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72987) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 01:56:13 devstack cinder-volume[72987]: DEBUG dbcounter [-] [72987] Writer thread running {{(pid=72987) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 01:56:13 devstack cinder-volume[72987]: DEBUG cinder.db.sqlalchemy.api [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Building query based on filter {{(pid=72987) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 01:56:13 devstack cinder-volume[72987]: DEBUG cinder.image.image_utils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72987) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 01:56:13 devstack cinder-volume[72987]: INFO cinder.keymgr.migration [None req-3885e02f-9675-4ee8-aeaa-2a8fe4def3b7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 01:56:13 devstack cinder-volume[72987]: DEBUG cinder.volume.drivers.lvm [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Updating volume stats {{(pid=72987) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:56:13 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:13 devstack sudo[73983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:56:13 devstack sudo[73983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:13 devstack sudo[73983]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:13 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.485s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:13 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:13 devstack sudo[73990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:56:13 devstack sudo[73990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:14 devstack sudo[73990]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:14 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:14 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:14 devstack cinder-volume[72850]: DEBUG dbcounter [-] [72850] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72850) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 01:56:14 devstack sudo[73996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:14 devstack sudo[73996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:14 devstack sudo[73996]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:14 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.465s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:14 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:14 devstack sudo[74002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:56:14 devstack sudo[74002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:15 devstack sudo[74002]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:15 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.509s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:15 devstack cinder-volume[72987]: DEBUG cinder.manager [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Notifying Schedulers of capabilities ... {{(pid=72987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 01:56:15 devstack cinder-volume[72987]: INFO cinder.volume.manager [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Driver initialization completed successfully. Feb 27 01:56:15 devstack cinder-volume[72987]: INFO cinder.manager [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Initiating service 2 cleanup Feb 27 01:56:15 devstack cinder-volume[72987]: INFO cinder.manager [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Service 2 cleanup completed. Feb 27 01:56:15 devstack cinder-volume[72987]: DEBUG cinder.service [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Creating RPC server for service cinder-volume {{(pid=72987) start /opt/stack/cinder/cinder/service.py:231}} Feb 27 01:56:15 devstack cinder-volume[72987]: DEBUG cinder.service [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72987) start /opt/stack/cinder/cinder/service.py:237}} Feb 27 01:56:15 devstack cinder-volume[72987]: INFO cinder.volume.manager [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Feb 27 01:56:15 devstack cinder-volume[72987]: DEBUG cinder.volume.drivers.lvm [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Updating volume stats {{(pid=72987) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:56:15 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:15 devstack sudo[74005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:56:15 devstack sudo[74005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:15 devstack sudo[74005]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:15 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.467s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:15 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:15 devstack sudo[74065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:56:15 devstack sudo[74065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:16 devstack sudo[74065]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:16 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.463s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:16 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:16 devstack sudo[74068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:56:16 devstack sudo[74068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:16 devstack sudo[74068]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:16 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.448s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:16 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:56:16 devstack sudo[74071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:56:16 devstack sudo[74071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:56:17 devstack sudo[74071]: pam_unix(sudo:session): session closed for user root Feb 27 01:56:17 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:56:17 devstack cinder-volume[72987]: INFO cinder.volume.manager [None req-c1cbc211-0cdf-4bb5-b0db-eedf43201607 None None] Driver post RPC initialization completed successfully. Feb 27 01:56:25 devstack cinder-volume[72987]: DEBUG dbcounter [-] [72987] Writing DB stats cinder:SELECT=3 {{(pid=72987) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 01:56:27 devstack cinder-volume[72987]: DEBUG dbcounter [-] [72987] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72987) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 01:57:49 devstack cinder-volume[72987]: DEBUG oslo_service.periodic_task [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72987) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 01:57:49 devstack cinder-volume[72987]: DEBUG cinder.volume.drivers.lvm [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] Updating volume stats {{(pid=72987) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:57:49 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:49 devstack sudo[79083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:57:49 devstack sudo[79083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:49 devstack sudo[79083]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:49 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:49 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:49 devstack sudo[79086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:57:49 devstack sudo[79086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:49 devstack sudo[79086]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:49 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.418s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:49 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:49 devstack sudo[79091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:57:49 devstack sudo[79091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:50 devstack sudo[79091]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:50 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.452s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:50 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:57:50 devstack sudo[79100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:57:50 devstack sudo[79100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:57:50 devstack sudo[79100]: pam_unix(sudo:session): session closed for user root Feb 27 01:57:50 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.419s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:57:50 devstack cinder-volume[72987]: DEBUG cinder.manager [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] Notifying Schedulers of capabilities ... {{(pid=72987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 01:58:27 devstack cinder-volume[72987]: DEBUG dbcounter [-] [72987] Writing DB stats cinder:SELECT=1 {{(pid=72987) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 01:58:27 devstack cinder-volume[72987]: DEBUG dbcounter [-] [72987] Writing DB stats cinder:UPDATE=1 {{(pid=72987) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 01:58:49 devstack cinder-volume[72987]: DEBUG oslo_service.periodic_task [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72987) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 01:58:49 devstack cinder-volume[72987]: DEBUG cinder.volume.drivers.lvm [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] Updating volume stats {{(pid=72987) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:58:49 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:49 devstack sudo[80809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:58:49 devstack sudo[80809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:49 devstack sudo[80809]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:49 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:49 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:49 devstack sudo[80831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:58:49 devstack sudo[80831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:49 devstack sudo[80831]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:49 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:49 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:49 devstack sudo[80858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:58:49 devstack sudo[80858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:50 devstack sudo[80858]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:50 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.434s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:50 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:58:50 devstack sudo[80882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:58:50 devstack sudo[80882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:58:50 devstack sudo[80882]: pam_unix(sudo:session): session closed for user root Feb 27 01:58:50 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:58:50 devstack cinder-volume[72987]: DEBUG cinder.manager [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] Notifying Schedulers of capabilities ... {{(pid=72987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 01:59:49 devstack cinder-volume[72987]: DEBUG oslo_service.periodic_task [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72987) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 01:59:49 devstack cinder-volume[72987]: DEBUG cinder.volume.drivers.lvm [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] Updating volume stats {{(pid=72987) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 27 01:59:49 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:59:49 devstack sudo[81865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 27 01:59:49 devstack sudo[81865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:59:49 devstack sudo[81865]: pam_unix(sudo:session): session closed for user root Feb 27 01:59:49 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:59:49 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:59:49 devstack sudo[81869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:59:49 devstack sudo[81869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:59:49 devstack sudo[81869]: pam_unix(sudo:session): session closed for user root Feb 27 01:59:49 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:59:49 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:59:49 devstack sudo[81894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 27 01:59:49 devstack sudo[81894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:59:50 devstack sudo[81894]: pam_unix(sudo:session): session closed for user root Feb 27 01:59:50 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.453s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:59:50 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 01:59:50 devstack sudo[81900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 27 01:59:50 devstack sudo[81900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 01:59:50 devstack sudo[81900]: pam_unix(sudo:session): session closed for user root Feb 27 01:59:50 devstack cinder-volume[72987]: DEBUG oslo_concurrency.processutils [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=72987) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 01:59:50 devstack cinder-volume[72987]: DEBUG cinder.manager [None req-dbc4906d-6d75-4dad-b69d-179f727a92a4 None None] Notifying Schedulers of capabilities ... {{(pid=72987) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 01:59:56 devstack cinder-volume[72850]: INFO oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Caught SIGTERM, stopping children Feb 27 01:59:56 devstack cinder-volume[72850]: DEBUG oslo_concurrency.lockutils [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Acquiring lock "singleton_lock" {{(pid=72850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 01:59:56 devstack cinder-volume[72850]: DEBUG oslo_concurrency.lockutils [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Acquired lock "singleton_lock" {{(pid=72850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 01:59:56 devstack cinder-volume[72850]: DEBUG oslo_concurrency.lockutils [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Releasing lock "singleton_lock" {{(pid=72850) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 01:59:56 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Stop services. {{(pid=72850) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 27 01:59:56 devstack cinder-volume[72850]: DEBUG oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Killing children. {{(pid=72850) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 27 01:59:56 devstack cinder-volume[72850]: INFO oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Waiting on 1 children to exit Feb 27 02:00:00 devstack cinder-volume[72987]: DEBUG oslo_concurrency.lockutils [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Acquiring lock "singleton_lock" {{(pid=72987) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:00:00 devstack cinder-volume[72987]: DEBUG oslo_concurrency.lockutils [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Acquired lock "singleton_lock" {{(pid=72987) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:00:00 devstack cinder-volume[72987]: DEBUG oslo_concurrency.lockutils [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Releasing lock "singleton_lock" {{(pid=72987) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:00:00 devstack cinder-volume[72987]: WARNING amqp [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 02:00:00 devstack cinder-volume[72987]: WARNING amqp [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 02:00:00 devstack cinder-volume[72850]: INFO oslo_service.backend._eventlet.service [None req-a2d25faf-7f2b-4f22-9ef6-24347bafed6d None None] Child 72987 exited with status 0 Feb 27 02:00:02 devstack cinder-volume[82166]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82166) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:00:02 devstack cinder-volume[82166]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82166) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:00:02 devstack cinder-volume[82166]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82166) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:00:03 devstack cinder-volume[82166]: INFO dbcounter [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Registered counter for database cinder Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_db.sqlalchemy.engines [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82166) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG dbcounter [-] [82166] Writer thread running {{(pid=82166) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 02:00:03 devstack cinder-volume[82166]: INFO cinder.rpc [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 02:00:03 devstack cinder-volume[82166]: INFO cinder.rpc [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_db.sqlalchemy.engines [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82166) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:03 devstack cinder-volume[82166]: INFO cinder.volume.manager [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Determined volume DB was empty at startup. Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG cinder.volume.manager [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82166) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 27 02:00:03 devstack cinder-volume[82166]: INFO cinder.volume.manager [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 27 02:00:03 devstack cinder-volume[82166]: WARNING stevedore.named [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 02:00:03 devstack cinder-volume[82166]: WARNING castellan.key_manager [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 02:00:03 devstack cinder-volume[82166]: WARNING cinder.keymgr.conf_key_mgr [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 02:00:03 devstack cinder-volume[82166]: INFO cinder.volume.manager [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_db.sqlalchemy.engines [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82166) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:03 devstack cinder-volume[82166]: INFO oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Starting 1 workers Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Started child 82319 {{(pid=82166) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Full set of CONF: {{(pid=82166) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] ******************************************************************************** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Configuration options gathered from: {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] ================================================================================ {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] allow_availability_zone_fallback = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] allow_compression_on_image_upload = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] allowed_direct_url_schemes = [] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] api_rate_limit = True {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] auth_strategy = keystone {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_availability_zone = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_host = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82319]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_name = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_stats_polling_interval = 60 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backup_api_class = cinder.backup.api.API {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backup_name_template = backup-%s {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backup_use_same_host = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backup_use_temp_snapshot = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] chap_password = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] chap_username = {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cinder_internal_tenant_project_id = 35c5795673c140c6af16eb2d458d5e62 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cinder_internal_tenant_user_id = 9a444f56fad2404ba1d37bf0852dbcf5 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cluster = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] compression_format = gzip {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] compute_api_class = cinder.compute.nova.API {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] config_dir = [] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] config_source = [] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] control_exchange = openstack {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] debug = True {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] default_availability_zone = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] default_group_type = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] default_volume_type = QuobyteHD {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] disk_geometry = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] driver_client_cert = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] driver_client_cert_key = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] driver_data_namespace = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] driver_ssl_cert_path = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] driver_ssl_cert_verify = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] driver_use_ssl = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] enable_new_services = True {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] enable_unsupported_driver = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] enabled_backends = ['QuobyteHD'] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] enforce_multipath_for_image_xfer = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] filter_function = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] glance_api_insecure = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] glance_api_servers = ['http://192.168.122.79/image'] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] glance_api_ssl_compression = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] glance_ca_certificates_file = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] glance_catalog_info = image:glance:publicURL {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] glance_certfile = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] glance_keyfile = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] glance_num_retries = 3 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] glance_request_timeout = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] goodness_function = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] graceful_shutdown_timeout = 5 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] group_api_class = cinder.group.api.API {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] host = devstack {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] image_compress_on_upload = True {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] image_conversion_address_space_limit = 1 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] image_conversion_cpu_limit = 60 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] image_conversion_disable = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] image_upload_use_cinder_backend = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] image_upload_use_internal_tenant = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] image_volume_cache_enabled = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] image_volume_cache_max_count = 0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] image_volume_cache_max_size_gb = 0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] init_host_max_objects_retrieval = 0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] instance_format = [instance: %(uuid)s] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] iscsi_target_flags = {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] iscsi_write_cache = on {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] iser_helper = tgtadm {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] iser_ip_address = 192.168.122.79 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] iser_port = 3260 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] log_color = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] log_config_append = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] log_dir = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] log_file = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] log_options = True {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] log_rotate_interval = 1 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] log_rotate_interval_type = days {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] log_rotation_type = none {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] max_age = 0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] max_logfile_count = 30 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] max_logfile_size_mb = 200 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] max_over_subscription_ratio = 20.0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] message_reap_interval = 86400 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] message_ttl = 2592000 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] migration_create_volume_timeout_secs = 300 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] monkey_patch = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] monkey_patch_modules = [] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] my_ip = 192.168.122.79 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] no_snapshot_gb_quota = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] num_iser_scan_tries = 3 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] num_shell_tries = 3 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] num_volume_device_scan_tries = 3 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] nvmeof_conn_info_version = 1 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] nvmet_ns_id = 10 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] nvmet_port_id = 1 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] osapi_max_limit = 1000 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] osapi_volume_ext_list = [] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] osapi_volume_listen_port = 8776 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] osapi_volume_use_ssl = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] osapi_volume_workers = 2 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] per_volume_size_limit = -1 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] periodic_fuzzy_delay = 60 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] periodic_interval = 60 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] public_endpoint = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] publish_errors = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] quota_backup_gigabytes = 1000 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] quota_backups = 10 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] quota_gigabytes = 1000 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] quota_groups = 10 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] quota_snapshots = 10 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] quota_volumes = 10 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] rate_limit_burst = 0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] rate_limit_except_level = CRITICAL {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] rate_limit_interval = 0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] reinit_driver_count = 3 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] replication_device = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] report_discard_supported = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] report_interval = 120 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] reservation_clean_interval = 86400 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] reservation_expire = 86400 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] reserved_image_namespaces = [] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] reserved_percentage = 0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] rpc_response_timeout = 120 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] run_external_periodic_tasks = True {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] scst_target_driver = iscsi {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] scst_target_iqn_name = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] service_down_time = 720 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] shell_completion = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] snapshot_name_template = snapshot-%s {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] split_loggers = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] state_path = /opt/stack/data/cinder {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] storage_availability_zone = nova {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] storage_protocol = iSCSI {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] syslog_log_facility = LOG_USER {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] target_helper = lioadm {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] target_ip_address = 192.168.122.79 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] target_port = 3260 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] target_protocol = iscsi {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] target_secondary_ip_addresses = [] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] trace_flags = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] transport_url = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] until_refresh = 0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] use_chap_auth = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] use_default_quota_class = True {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] use_journal = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] use_json = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] use_multipath_for_image_xfer = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] use_stderr = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] use_syslog = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] verify_glance_signatures = enabled {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] volume_api_class = cinder.volume.api.API {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] volume_backend_name = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] volume_clear = zero {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] volume_clear_ionice = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] volume_clear_size = 0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] volume_copy_bps_limit = 0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] volume_dd_blocksize = 1M {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] volume_name_template = volume-%s {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] volume_service_inithost_offload = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] volume_usage_audit_period = month {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] zoning_mode = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:03 devstack cinder-volume[82319]: INFO cinder.volume.manager [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Starting volume driver QuobyteDriver (1.1.14) Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_concurrency.disable_process_locking = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82319]: DEBUG cinder.volume.drivers.remotefs [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82319) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.admin_password = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.admin_token = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.admin_user = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.auth_port = 35357 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.auth_protocol = https {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.auth_section = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.auth_type = password {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.auth_uri = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.auth_version = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.cache = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.certfile = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.identity_uri = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.include_service_catalog = True {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.insecure = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.interface = public {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.keyfile = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.memcache_password = {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.memcache_username = {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.region_name = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.service_type = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.79/identity {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.backend = dogpile.cache.null {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.backend_argument = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.backend_expiration_time = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.config_prefix = cache.oslo {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.debug_cache_backend = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.enable_retry_client = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.enable_socket_keepalive = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.enabled = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.enforce_fips_mode = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.expiration_time = 600 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.hashclient_retry_attempts = 2 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.memcache_dead_retry = 300 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.memcache_pool_maxsize = 10 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.memcache_sasl_enabled = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.password = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.proxies = [] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.redis_db = 0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.redis_server = localhost:6379 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.retry_attempts = 2 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.retry_delay = 0.0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.socket_keepalive_count = 1 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.socket_keepalive_idle = 1 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.socket_keepalive_interval = 1 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.socket_timeout = 1.0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.tls_allowed_ciphers = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.tls_cafile = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.tls_certfile = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.tls_enabled = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.tls_keyfile = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cache.username = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] coordination.backend_url = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.asyncio_connection = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.asyncio_slave_connection = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.backend = sqlalchemy {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.connection = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.connection_debug = 0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.connection_parameters = {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.connection_recycle_time = 3600 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.connection_trace = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.db_inc_retry_interval = True {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.db_max_retries = 20 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.db_max_retry_interval = 10 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.db_retry_interval = 1 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.max_overflow = 50 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.max_pool_size = 5 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.max_retries = 10 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.mysql_wsrep_sync_wait = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.pool_timeout = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.retry_interval = 10 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.slave_connection = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.sqlite_synchronous = True {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.synchronous_reader = True {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] database.use_db_reconnect = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] profiler.connection_string = messaging:// {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] profiler.enabled = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] profiler.es_doc_type = notification {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] profiler.es_scroll_size = 10000 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] profiler.es_scroll_time = 2m {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] profiler.filter_error_trace = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] profiler.hmac_keys = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] profiler.sentinel_service_name = mymaster {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] profiler.socket_timeout = 0.1 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] profiler.trace_requests = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] profiler.trace_sqlalchemy = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] profiler_jaeger.process_tags = {} {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] profiler_jaeger.service_name_prefix = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] profiler_otlp.service_name_prefix = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_policy.enforce_new_defaults = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: WARNING oslo_config.cfg [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_policy.enforce_scope = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_policy.policy_default_rule = default {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_policy.policy_file = policy.yaml {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] privsep_osbrick.group = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] privsep_osbrick.helper_command = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] privsep_osbrick.user = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cinder_sys_admin.group = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cinder_sys_admin.helper_command = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] cinder_sys_admin.user = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] service_user.auth_section = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] service_user.auth_type = password {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] service_user.cafile = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] service_user.certfile = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] service_user.collect_timing = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] service_user.insecure = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] service_user.keyfile = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] service_user.send_service_user_token = True {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] service_user.split_loggers = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] service_user.timeout = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] glance.auth_section = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] glance.auth_type = password {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] glance.certfile = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] glance.collect_timing = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] glance.insecure = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] glance.keyfile = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] glance.region_name = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] glance.split_loggers = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] glance.timeout = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.backend_availability_zone = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.chap_password = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.chap_username = {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.disk_geometry = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.driver_client_cert = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.driver_client_cert_key = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.driver_data_namespace = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.driver_use_ssl = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.extra_capabilities = {} {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.filter_function = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.goodness_function = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.iscsi_target_flags = {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.iscsi_write_cache = on {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.iser_helper = tgtadm {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.iser_ip_address = 192.168.122.79 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.iser_port = 3260 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.nas_host = {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.nas_login = admin {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.nas_mount_options = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.nas_password = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.nas_private_key = {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.nas_share_path = {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.num_shell_tries = 3 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.quobyte_volume_url = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.replication_device = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.report_discard_supported = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.reserved_percentage = 0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.target_helper = tgtadm {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.target_ip_address = 192.168.122.79 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.target_port = 3260 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.target_protocol = iscsi {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.trace_flags = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.unique_fqdn_network = True {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.use_chap_auth = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.volume_backend_name = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.volume_clear = zero {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.volume_clear_ionice = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.volume_clear_size = 0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_reports.file_event_handler = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_reports.log_dir = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.backend_availability_zone = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.backend_host = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.chap_password = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.chap_username = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.chiscsi_conf = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.disk_geometry = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.driver_client_cert = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.driver_data_namespace = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.driver_use_ssl = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.extra_capabilities = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.filter_function = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.goodness_function = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.iser_helper = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.iser_ip_address = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.iser_port = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.iser_target_prefix = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.nas_host = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.nas_login = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.nas_mount_options = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.nas_password = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.nas_private_key = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.nas_share_path = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.nas_ssh_port = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.num_shell_tries = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.nvmet_port_id = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.replication_device = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.report_discard_supported = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.reserved_percentage = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.scst_target_driver = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.storage_protocol = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.target_helper = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.target_ip_address = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.target_port = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.target_prefix = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.target_protocol = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.trace_flags = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.use_chap_auth = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.volume_clear = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.volume_clear_size = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] QuobyteHD.volumes_dir = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.ssl = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_notifications.driver = [] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_notifications.retry = -1 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] key_manager.fixed_key = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82319]: DEBUG cinder.volume.drivers.quobyte [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82319) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican.barbican_api_version = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican.barbican_endpoint = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican.barbican_endpoint_type = public {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican.barbican_region_name = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican.cafile = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican.certfile = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican.collect_timing = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican.insecure = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican.keyfile = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican.number_of_retries = 60 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican.retry_delay = 1 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican.send_service_user_token = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican.split_loggers = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican.timeout = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican.verify_ssl = True {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican.verify_ssl_path = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican_service_user.auth_section = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican_service_user.auth_type = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican_service_user.cafile = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican_service_user.certfile = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82319]: WARNING cinder.volume.drivers.quobyte [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican_service_user.collect_timing = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican_service_user.insecure = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican_service_user.keyfile = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican_service_user.split_loggers = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] barbican_service_user.timeout = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] vault.approle_role_id = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] vault.approle_secret_id = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] vault.kv_mountpoint = secret {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] vault.kv_path = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] vault.kv_version = 2 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] vault.namespace = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] vault.root_token_id = **** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] vault.ssl_ca_crt_file = None {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] vault.timeout = 60.0 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] vault.use_ssl = False {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:03 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] ******************************************************************************** {{(pid=82166) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 02:00:03 devstack cinder-volume[82319]: WARNING cinder.volume.drivers.quobyte [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 27 02:00:03 devstack cinder-volume[82319]: DEBUG oslo_concurrency.processutils [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Running cmd (subprocess): mount.quobyte {{(pid=82319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:03 devstack quobyte-client[82320]: Reading configuration file: /etc/quobyte/client.cfg Feb 27 02:00:03 devstack quobyte-client[82320]: Invalid parameters found, error: missing mount point. Feb 27 02:00:03 devstack quobyte-client[82320]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 27 02:00:03 devstack quobyte-client[82320]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 27 02:00:03 devstack cinder-volume[82319]: DEBUG oslo_concurrency.processutils [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] CMD "mount.quobyte" returned: 1 in 0.059s {{(pid=82319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:03 devstack cinder-volume[82319]: DEBUG oslo_concurrency.lockutils [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:00:03 devstack cinder-volume[82319]: DEBUG oslo_concurrency.lockutils [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:00:03 devstack cinder-volume[82319]: DEBUG cinder.volume.drivers.quobyte [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82319) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:00:03 devstack cinder-volume[82319]: INFO cinder.volume.drivers.quobyte [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 ... Feb 27 02:00:03 devstack cinder-volume[82319]: DEBUG oslo_concurrency.processutils [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb -c /etc/quobyte/client-cinder.cfg {{(pid=82319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:03 devstack sudo[82321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb -c /etc/quobyte/client-cinder.cfg Feb 27 02:00:03 devstack sudo[82321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:04 devstack sudo[82321]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:04 devstack cinder-volume[82319]: DEBUG oslo_concurrency.processutils [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.543s {{(pid=82319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:04 devstack cinder-volume[82319]: INFO cinder.volume.drivers.quobyte [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 succeeded Feb 27 02:00:04 devstack cinder-volume[82319]: DEBUG cinder.volume.drivers.quobyte [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82319) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:00:04 devstack cinder-volume[82319]: DEBUG oslo_concurrency.lockutils [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.552s {{(pid=82319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:00:04 devstack cinder-volume[82319]: DEBUG oslo_concurrency.processutils [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:04 devstack sudo[82390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:00:04 devstack sudo[82390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:04 devstack sudo[82390]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:04 devstack cinder-volume[82319]: DEBUG oslo_concurrency.processutils [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.504s {{(pid=82319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:04 devstack cinder-volume[82319]: INFO cinder.volume.driver [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Driver hasn't implemented _init_vendor_properties() Feb 27 02:00:04 devstack cinder-volume[82319]: DEBUG cinder.volume.driver [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82319) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 02:00:04 devstack cinder-volume[82319]: DEBUG oslo_db.sqlalchemy.engines [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82319) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:04 devstack cinder-volume[82319]: DEBUG dbcounter [-] [82319] Writer thread running {{(pid=82319) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 02:00:04 devstack cinder-volume[82319]: DEBUG cinder.db.sqlalchemy.api [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Building query based on filter {{(pid=82319) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 02:00:04 devstack cinder-volume[82319]: DEBUG cinder.image.image_utils [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82319) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 02:00:04 devstack cinder-volume[82319]: INFO cinder.keymgr.migration [None req-9c9cb059-d424-4b22-8563-c3fe3249aa48 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 02:00:04 devstack cinder-volume[82319]: DEBUG oslo_concurrency.lockutils [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:00:04 devstack cinder-volume[82319]: DEBUG oslo_concurrency.lockutils [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:00:04 devstack cinder-volume[82319]: DEBUG cinder.volume.drivers.quobyte [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82319) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:00:04 devstack cinder-volume[82319]: DEBUG cinder.volume.drivers.quobyte [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82319) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:00:04 devstack cinder-volume[82319]: DEBUG oslo_concurrency.lockutils [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:00:04 devstack cinder-volume[82319]: DEBUG oslo_concurrency.processutils [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:04 devstack sudo[82418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:00:04 devstack sudo[82418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:05 devstack sudo[82418]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:05 devstack cinder-volume[82319]: DEBUG oslo_concurrency.processutils [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.651s {{(pid=82319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:05 devstack cinder-volume[82319]: DEBUG cinder.manager [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Notifying Schedulers of capabilities ... {{(pid=82319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:00:05 devstack cinder-volume[82319]: INFO cinder.volume.manager [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Driver initialization completed successfully. Feb 27 02:00:05 devstack cinder-volume[82319]: INFO cinder.manager [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Initiating service 3 cleanup Feb 27 02:00:05 devstack cinder-volume[82319]: INFO cinder.manager [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Service 3 cleanup completed. Feb 27 02:00:05 devstack cinder-volume[82319]: DEBUG cinder.service [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Creating RPC server for service cinder-volume {{(pid=82319) start /opt/stack/cinder/cinder/service.py:231}} Feb 27 02:00:05 devstack cinder-volume[82319]: DEBUG cinder.service [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82319) start /opt/stack/cinder/cinder/service.py:237}} Feb 27 02:00:05 devstack cinder-volume[82319]: INFO cinder.volume.manager [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 27 02:00:05 devstack cinder-volume[82319]: DEBUG oslo_concurrency.lockutils [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:00:05 devstack cinder-volume[82319]: DEBUG oslo_concurrency.lockutils [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:00:05 devstack cinder-volume[82319]: DEBUG cinder.volume.drivers.quobyte [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82319) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:00:05 devstack cinder-volume[82319]: DEBUG cinder.volume.drivers.quobyte [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82319) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:00:05 devstack cinder-volume[82319]: DEBUG oslo_concurrency.lockutils [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:00:05 devstack cinder-volume[82319]: DEBUG oslo_concurrency.processutils [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:05 devstack sudo[82457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:00:05 devstack sudo[82457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:06 devstack sudo[82457]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:06 devstack cinder-volume[82319]: DEBUG oslo_concurrency.processutils [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.392s {{(pid=82319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:06 devstack cinder-volume[82319]: INFO cinder.volume.manager [None req-bd7f5798-495b-4d9a-a18e-a0e7722022e3 None None] Driver post RPC initialization completed successfully. Feb 27 02:00:07 devstack cinder-volume[82319]: DEBUG oslo_concurrency.lockutils [None req-3f7e9e35-9dad-49b3-99f6-c1bee3d60449 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:00:07 devstack cinder-volume[82319]: DEBUG oslo_concurrency.lockutils [None req-3f7e9e35-9dad-49b3-99f6-c1bee3d60449 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:00:07 devstack cinder-volume[82319]: DEBUG cinder.volume.drivers.quobyte [None req-3f7e9e35-9dad-49b3-99f6-c1bee3d60449 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82319) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:00:07 devstack cinder-volume[82319]: DEBUG cinder.volume.drivers.quobyte [None req-3f7e9e35-9dad-49b3-99f6-c1bee3d60449 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82319) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:00:07 devstack cinder-volume[82319]: DEBUG oslo_concurrency.lockutils [None req-3f7e9e35-9dad-49b3-99f6-c1bee3d60449 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:00:07 devstack cinder-volume[82319]: DEBUG oslo_concurrency.processutils [None req-3f7e9e35-9dad-49b3-99f6-c1bee3d60449 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:07 devstack sudo[82463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:00:07 devstack sudo[82463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:08 devstack sudo[82463]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:08 devstack cinder-volume[82319]: DEBUG oslo_concurrency.processutils [None req-3f7e9e35-9dad-49b3-99f6-c1bee3d60449 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.405s {{(pid=82319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:08 devstack cinder-volume[82319]: DEBUG cinder.manager [None req-3f7e9e35-9dad-49b3-99f6-c1bee3d60449 None None] Notifying Schedulers of capabilities ... {{(pid=82319) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:00:11 devstack cinder-volume[82166]: INFO oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Caught SIGTERM, stopping children Feb 27 02:00:11 devstack cinder-volume[82166]: DEBUG oslo_concurrency.lockutils [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Acquiring lock "singleton_lock" {{(pid=82166) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:00:11 devstack cinder-volume[82166]: DEBUG oslo_concurrency.lockutils [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Acquired lock "singleton_lock" {{(pid=82166) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:00:11 devstack cinder-volume[82166]: DEBUG oslo_concurrency.lockutils [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Releasing lock "singleton_lock" {{(pid=82166) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:00:11 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Stop services. {{(pid=82166) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 27 02:00:11 devstack cinder-volume[82166]: DEBUG oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Killing children. {{(pid=82166) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 27 02:00:11 devstack cinder-volume[82166]: INFO oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Waiting on 1 children to exit Feb 27 02:00:13 devstack cinder-volume[82319]: DEBUG oslo_concurrency.lockutils [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Acquiring lock "singleton_lock" {{(pid=82319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:00:13 devstack cinder-volume[82319]: DEBUG oslo_concurrency.lockutils [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Acquired lock "singleton_lock" {{(pid=82319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:00:13 devstack cinder-volume[82319]: DEBUG oslo_concurrency.lockutils [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Releasing lock "singleton_lock" {{(pid=82319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:00:13 devstack cinder-volume[82319]: WARNING amqp [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 02:00:13 devstack cinder-volume[82319]: WARNING amqp [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 27 02:00:13 devstack cinder-volume[82166]: INFO oslo_service.backend._eventlet.service [None req-a109fd6d-f84c-49b5-af31-7f83d941d853 None None] Child 82319 exited with status 0 Feb 27 02:00:15 devstack cinder-volume[82545]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82545) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 27 02:00:15 devstack cinder-volume[82545]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82545) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 27 02:00:15 devstack cinder-volume[82545]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82545) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 27 02:00:16 devstack cinder-volume[82545]: INFO dbcounter [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] Registered counter for database cinder Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_db.sqlalchemy.engines [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82545) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG dbcounter [-] [82545] Writer thread running {{(pid=82545) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 02:00:16 devstack cinder-volume[82545]: INFO cinder.rpc [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 27 02:00:16 devstack cinder-volume[82545]: INFO cinder.rpc [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_db.sqlalchemy.engines [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82545) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:16 devstack cinder-volume[82545]: INFO cinder.volume.manager [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] Determined volume DB was empty at startup. Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG cinder.volume.manager [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82545) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 27 02:00:16 devstack cinder-volume[82545]: WARNING stevedore.named [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 27 02:00:16 devstack cinder-volume[82545]: WARNING castellan.key_manager [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 02:00:16 devstack cinder-volume[82545]: WARNING cinder.keymgr.conf_key_mgr [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 27 02:00:16 devstack cinder-volume[82545]: INFO cinder.volume.manager [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_db.sqlalchemy.engines [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82545) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:16 devstack cinder-volume[82545]: INFO oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] Starting 1 workers Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] Started child 82683 {{(pid=82545) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] Full set of CONF: {{(pid=82545) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] ******************************************************************************** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] Configuration options gathered from: {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] ================================================================================ {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] allow_availability_zone_fallback = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] allow_compression_on_image_upload = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] allowed_direct_url_schemes = [] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] api_rate_limit = True {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] auth_strategy = keystone {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_availability_zone = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_host = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_name = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_stats_polling_interval = 60 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backup_api_class = cinder.backup.api.API {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backup_name_template = backup-%s {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backup_use_same_host = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backup_use_temp_snapshot = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] chap_password = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] chap_username = {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cinder_internal_tenant_project_id = 35c5795673c140c6af16eb2d458d5e62 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cinder_internal_tenant_user_id = 9a444f56fad2404ba1d37bf0852dbcf5 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cluster = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] compression_format = gzip {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] compute_api_class = cinder.compute.nova.API {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] config_dir = [] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] config_source = [] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] control_exchange = openstack {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] debug = True {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] default_availability_zone = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] default_group_type = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] default_volume_type = QuobyteHD {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] disk_geometry = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] driver_client_cert = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] driver_client_cert_key = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] driver_data_namespace = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] driver_ssl_cert_path = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] driver_ssl_cert_verify = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] driver_use_ssl = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] enable_new_services = True {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] enable_unsupported_driver = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] enabled_backends = ['QuobyteHD'] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] enforce_multipath_for_image_xfer = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] filter_function = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] glance_api_insecure = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] glance_api_servers = ['http://192.168.122.79/image'] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] glance_api_ssl_compression = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] glance_ca_certificates_file = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] glance_catalog_info = image:glance:publicURL {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] glance_certfile = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] glance_keyfile = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] glance_num_retries = 3 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] glance_request_timeout = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] goodness_function = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] graceful_shutdown_timeout = 5 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] group_api_class = cinder.group.api.API {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] host = devstack {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] image_compress_on_upload = True {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] image_conversion_address_space_limit = 1 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] image_conversion_cpu_limit = 60 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] image_conversion_disable = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] image_upload_use_cinder_backend = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] image_upload_use_internal_tenant = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] image_volume_cache_enabled = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82683]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] image_volume_cache_max_count = 0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] image_volume_cache_max_size_gb = 0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] init_host_max_objects_retrieval = 0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] instance_format = [instance: %(uuid)s] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] iscsi_target_flags = {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] iscsi_write_cache = on {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] iser_helper = tgtadm {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] iser_ip_address = 192.168.122.79 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] iser_port = 3260 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] log_color = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] log_config_append = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] log_dir = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] log_file = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] log_options = True {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] log_rotate_interval = 1 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] log_rotate_interval_type = days {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] log_rotation_type = none {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] max_age = 0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] max_logfile_count = 30 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] max_logfile_size_mb = 200 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] max_over_subscription_ratio = 20.0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] message_reap_interval = 86400 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] message_ttl = 2592000 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] migration_create_volume_timeout_secs = 300 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] monkey_patch = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] monkey_patch_modules = [] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] my_ip = 192.168.122.79 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] no_snapshot_gb_quota = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] num_iser_scan_tries = 3 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] num_shell_tries = 3 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] num_volume_device_scan_tries = 3 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] nvmeof_conn_info_version = 1 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] nvmet_ns_id = 10 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] nvmet_port_id = 1 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] osapi_max_limit = 1000 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] osapi_volume_ext_list = [] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] osapi_volume_listen = 0.0.0.0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] osapi_volume_listen_port = 8776 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] osapi_volume_use_ssl = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] osapi_volume_workers = 2 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] per_volume_size_limit = -1 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] periodic_fuzzy_delay = 60 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] periodic_interval = 60 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] project_id_regex = [0-9a-f\-]+ {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] public_endpoint = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] publish_errors = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] quota_backup_gigabytes = 1000 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] quota_backups = 10 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] quota_gigabytes = 1000 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] quota_groups = 10 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] quota_snapshots = 10 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] quota_volumes = 10 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] rate_limit_burst = 0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] rate_limit_except_level = CRITICAL {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] rate_limit_interval = 0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] reinit_driver_count = 3 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] replication_device = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] report_discard_supported = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] report_interval = 120 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] reservation_clean_interval = 86400 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] reservation_expire = 86400 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] reserved_image_namespaces = [] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] reserved_percentage = 0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] rpc_response_timeout = 120 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] run_external_periodic_tasks = True {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] scst_target_driver = iscsi {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] scst_target_iqn_name = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] service_down_time = 720 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] shell_completion = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] snapshot_name_template = snapshot-%s {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] split_loggers = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] state_path = /opt/stack/data/cinder {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] storage_availability_zone = nova {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] storage_protocol = iSCSI {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] syslog_log_facility = LOG_USER {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] target_helper = lioadm {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] target_ip_address = 192.168.122.79 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] target_port = 3260 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] target_protocol = iscsi {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] target_secondary_ip_addresses = [] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] trace_flags = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] transfer_api_class = cinder.transfer.api.API {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] transport_url = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] until_refresh = 0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] use_chap_auth = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] use_default_quota_class = True {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] use_journal = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] use_json = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] use_multipath_for_image_xfer = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] use_stderr = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] use_syslog = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] verify_glance_signatures = enabled {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] volume_api_class = cinder.volume.api.API {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] volume_backend_name = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] volume_clear = zero {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] volume_clear_ionice = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] volume_clear_size = 0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Starting volume driver QuobyteDriver (1.1.14) Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82683) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] volume_copy_bps_limit = 0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] volume_dd_blocksize = 1M {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] volume_name_template = volume-%s {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] volume_service_inithost_offload = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] volume_usage_audit_period = month {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] zoning_mode = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_concurrency.disable_process_locking = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.admin_password = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.admin_token = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.admin_user = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.auth_admin_prefix = {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.auth_port = 35357 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.auth_protocol = https {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.auth_section = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.auth_type = password {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.auth_uri = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.auth_version = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.cache = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.certfile = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.delay_auth_decision = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.http_connect_timeout = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.identity_uri = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.include_service_catalog = True {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.insecure = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.interface = public {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.keyfile = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.memcache_password = {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.memcache_username = {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.region_name = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.service_token_roles_required = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.service_type = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.token_cache_time = 300 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.79/identity {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.backend = dogpile.cache.null {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.backend_argument = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.backend_expiration_time = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.config_prefix = cache.oslo {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.debug_cache_backend = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.enable_retry_client = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.enable_socket_keepalive = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.enabled = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.enforce_fips_mode = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.expiration_time = 600 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.hashclient_retry_attempts = 2 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.memcache_dead_retry = 300 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.memcache_pool_maxsize = 10 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.memcache_sasl_enabled = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.password = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.proxies = [] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.redis_db = 0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.redis_sentinel_service_name = mymaster {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.redis_server = localhost:6379 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.retry_attempts = 2 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.retry_delay = 0.0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.socket_keepalive_count = 1 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.socket_keepalive_idle = 1 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.socket_keepalive_interval = 1 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.socket_timeout = 1.0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.tls_allowed_ciphers = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.tls_cafile = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.tls_certfile = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.tls_enabled = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.tls_keyfile = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cache.username = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] coordination.backend_url = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.asyncio_connection = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.asyncio_slave_connection = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.backend = sqlalchemy {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.connection = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.connection_debug = 0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.connection_parameters = {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.connection_recycle_time = 3600 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.connection_trace = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.db_inc_retry_interval = True {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.db_max_retries = 20 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.db_max_retry_interval = 10 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.db_retry_interval = 1 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.max_overflow = 50 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.max_pool_size = 5 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.max_retries = 10 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.mysql_wsrep_sync_wait = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.pool_timeout = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.retry_interval = 10 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.slave_connection = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.sqlite_synchronous = True {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.synchronous_reader = True {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] database.use_db_reconnect = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] profiler.connection_string = messaging:// {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] profiler.enabled = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] profiler.es_doc_type = notification {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] profiler.es_scroll_size = 10000 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] profiler.es_scroll_time = 2m {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] profiler.filter_error_trace = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] profiler.hmac_keys = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] profiler.sentinel_service_name = mymaster {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] profiler.socket_timeout = 0.1 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] profiler.trace_requests = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] profiler.trace_sqlalchemy = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] profiler_jaeger.process_tags = {} {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] profiler_jaeger.service_name_prefix = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] profiler_otlp.service_name_prefix = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_policy.enforce_new_defaults = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: WARNING oslo_config.cfg [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_policy.enforce_scope = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_policy.policy_default_rule = default {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_policy.policy_file = policy.yaml {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_policy.remote_timeout = 60.0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] privsep_osbrick.group = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] privsep_osbrick.helper_command = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] privsep_osbrick.user = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cinder_sys_admin.group = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cinder_sys_admin.helper_command = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] cinder_sys_admin.user = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] service_user.auth_section = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] service_user.auth_type = password {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] service_user.cafile = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] service_user.certfile = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] service_user.collect_timing = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] service_user.insecure = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] service_user.keyfile = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] service_user.send_service_user_token = True {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] service_user.split_loggers = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] service_user.timeout = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] glance.auth_section = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] glance.auth_type = password {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] glance.certfile = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] glance.collect_timing = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] glance.insecure = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] glance.keyfile = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] glance.region_name = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] glance.split_loggers = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] glance.timeout = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82683) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 27 02:00:16 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.quobyte [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 27 02:00:16 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.quobyte [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.backend_availability_zone = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Running cmd (subprocess): mount.quobyte {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.chap_password = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.chap_username = {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.disk_geometry = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.driver_client_cert = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.driver_client_cert_key = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.driver_data_namespace = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.driver_use_ssl = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.enable_unsupported_driver = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.extra_capabilities = {} {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.filter_function = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.goodness_function = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.iscsi_target_flags = {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.iscsi_write_cache = on {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.iser_helper = tgtadm {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.iser_ip_address = 192.168.122.79 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.iser_port = 3260 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.nas_host = {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.nas_login = admin {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.nas_mount_options = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.nas_password = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.nas_private_key = {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.nas_share_path = {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.nas_ssh_port = 22 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.num_shell_tries = 3 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.nvmet_port_id = 1 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.quobyte_client_cfg = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.quobyte_volume_url = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.replication_device = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.report_discard_supported = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.reserved_percentage = 0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.scst_target_driver = iscsi {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.scst_target_iqn_name = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.storage_protocol = iSCSI {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.target_helper = tgtadm {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.target_ip_address = 192.168.122.79 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.target_port = 3260 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.target_protocol = iscsi {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.trace_flags = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.unique_fqdn_network = True {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.use_chap_auth = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.volume_backend_name = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.volume_clear = zero {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.volume_clear_ionice = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.volume_clear_size = 0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_reports.file_event_handler = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_reports.log_dir = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.backend_availability_zone = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.backend_host = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.chap_password = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.chap_username = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.chiscsi_conf = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.disk_geometry = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.driver_client_cert = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.driver_client_cert_key = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.driver_data_namespace = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.driver_use_ssl = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.extra_capabilities = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.filter_function = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.goodness_function = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.iscsi_target_flags = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.iscsi_write_cache = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.iser_helper = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.iser_ip_address = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.iser_port = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.iser_target_prefix = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.nas_host = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.nas_login = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.nas_mount_options = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.nas_password = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.nas_private_key = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.nas_share_path = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.nas_ssh_port = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.num_shell_tries = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.nvmet_ns_id = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.nvmet_port_id = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.replication_device = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.report_discard_supported = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.reserved_percentage = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.scst_target_driver = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack quobyte-client[82690]: Reading configuration file: /etc/quobyte/client.cfg Feb 27 02:00:16 devstack quobyte-client[82690]: Invalid parameters found, error: missing mount point. Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack quobyte-client[82690]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 27 02:00:16 devstack quobyte-client[82690]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.storage_protocol = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.target_helper = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.target_ip_address = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.target_port = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.target_prefix = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.target_protocol = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.trace_flags = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.unique_fqdn_network = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.use_chap_auth = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.volume_clear = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.volume_clear_ionice = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.volume_clear_size = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] QuobyteHD.volumes_dir = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.ssl = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.ssl_version = {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_notifications.driver = [] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_notifications.retry = -1 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] oslo_messaging_notifications.transport_url = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] key_manager.fixed_key = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican.barbican_api_version = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican.barbican_endpoint = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican.barbican_endpoint_type = public {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican.barbican_region_name = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican.cafile = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican.certfile = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican.collect_timing = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican.insecure = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican.keyfile = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican.number_of_retries = 60 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican.retry_delay = 1 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican.send_service_user_token = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican.split_loggers = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican.timeout = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican.verify_ssl = True {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican.verify_ssl_path = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican_service_user.auth_section = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican_service_user.auth_type = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican_service_user.cafile = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican_service_user.certfile = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican_service_user.collect_timing = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican_service_user.insecure = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican_service_user.keyfile = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican_service_user.split_loggers = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] barbican_service_user.timeout = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] vault.approle_role_id = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] vault.approle_secret_id = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] vault.kv_mountpoint = secret {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] vault.kv_path = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] vault.kv_version = 2 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] vault.namespace = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] vault.root_token_id = **** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] vault.ssl_ca_crt_file = None {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] vault.timeout = 60.0 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] vault.use_ssl = False {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 27 02:00:16 devstack cinder-volume[82545]: DEBUG oslo_service.backend._eventlet.service [None req-446b4a34-611d-45f2-9f43-f5f4b6559e5c None None] ******************************************************************************** {{(pid=82545) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 27 02:00:16 devstack sudo[82702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:00:16 devstack sudo[82702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:17 devstack sudo[82702]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.514s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:17 devstack cinder-volume[82683]: INFO cinder.volume.driver [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Driver hasn't implemented _init_vendor_properties() Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG cinder.volume.driver [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82683) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG oslo_db.sqlalchemy.engines [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82683) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writer thread running {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG cinder.db.sqlalchemy.api [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Building query based on filter {{(pid=82683) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82683) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:17 devstack cinder-volume[82683]: INFO cinder.keymgr.migration [None req-6a90e0ba-0a22-40a9-a2e2-d775283efbb0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 27 02:00:17 devstack sudo[82781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:00:17 devstack sudo[82781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:17 devstack sudo[82781]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.413s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:00:17 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Driver initialization completed successfully. Feb 27 02:00:17 devstack cinder-volume[82683]: INFO cinder.manager [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Initiating service 3 cleanup Feb 27 02:00:17 devstack cinder-volume[82683]: INFO cinder.manager [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Service 3 cleanup completed. Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG cinder.service [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Creating RPC server for service cinder-volume {{(pid=82683) start /opt/stack/cinder/cinder/service.py:231}} Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG cinder.service [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82683) start /opt/stack/cinder/cinder/service.py:237}} Feb 27 02:00:17 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:00:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:00:17 devstack sudo[82796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:00:17 devstack sudo[82796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:00:18 devstack sudo[82796]: pam_unix(sudo:session): session closed for user root Feb 27 02:00:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.406s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:00:18 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-a1ad8fec-9c79-42b4-8b57-e0c8d78e7149 None None] Driver post RPC initialization completed successfully. Feb 27 02:00:26 devstack cinder-volume[82545]: DEBUG dbcounter [-] [82545] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82545) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:00:27 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:SELECT=3 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:00:28 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:01:16 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-13807791-5a16-494f-9e05-b01377f95db7 tempest-GroupSnapshotsV319Test-1551701714 None] Group tempest-GroupSnapshotsV319Test-Group-579824670: creating Feb 27 02:01:16 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-13807791-5a16-494f-9e05-b01377f95db7 tempest-GroupSnapshotsV319Test-1551701714 None] Group tempest-GroupSnapshotsV319Test-Group-579824670: created successfully Feb 27 02:01:17 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-13807791-5a16-494f-9e05-b01377f95db7 tempest-GroupSnapshotsV319Test-1551701714 None] Create group completed successfully. Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Flow 'volume_create_manager' (e008b272-47c0-49f7-a237-7abb9321c081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddeaf804-4919-492d-a17c-0469675a0d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddeaf804-4919-492d-a17c-0469675a0d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2143383036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d0a9ac46-2e18-4553-b338-f367d1e96d95,host='devstack@QuobyteHD#QuobyteHD',id=bd3ee1d1-5390-4d34-964a-a02909622609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e6befdbb8447c0a9f023c309a34fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:19Z,use_quota=True,user_id='d4e785c7a21c4ff78cd6982fae6451b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b027808-85ed-47e5-9d77-11e8d62f8ce3),volume_type_id=0b027808-85ed-47e5-9d77-11e8d62f8ce3)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c269918f-c79d-4189-ac0b-633caa180b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c269918f-c79d-4189-ac0b-633caa180b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93296055-62bf-4d54-95f6-8f9c5209f1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93296055-62bf-4d54-95f6-8f9c5209f1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd3ee1d1-5390-4d34-964a-a02909622609', 'volume_name': 'volume-bd3ee1d1-5390-4d34-964a-a02909622609', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a3a6a4-2e0a-48bc-ad55-df9789621cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a3a6a4-2e0a-48bc-ad55-df9789621cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f372b458-d835-451d-b414-e2dfdd6d3978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:19 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Volume bd3ee1d1-5390-4d34-964a-a02909622609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd3ee1d1-5390-4d34-964a-a02909622609', 'volume_size': 1} Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d0a9ac46-2e18-4553-b338-f367d1e96d95,created_at=2026-02-27T01:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2143383036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d0a9ac46-2e18-4553-b338-f367d1e96d95,host='devstack@QuobyteHD#QuobyteHD',id=bd3ee1d1-5390-4d34-964a-a02909622609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e6befdbb8447c0a9f023c309a34fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:19Z,use_quota=True,user_id='d4e785c7a21c4ff78cd6982fae6451b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b027808-85ed-47e5-9d77-11e8d62f8ce3),volume_type_id=0b027808-85ed-47e5-9d77-11e8d62f8ce3)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Creating volume bd3ee1d1-5390-4d34-964a-a02909622609 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:01:19 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:01:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:19 devstack sudo[83155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609 1073741824 Feb 27 02:01:19 devstack sudo[83155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:22 devstack sudo[83155]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609 1073741824" returned: 0 in 2.381s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:22 devstack sudo[83472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609 Feb 27 02:01:22 devstack sudo[83472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Flow 'volume_create_manager' (5248b046-4ead-4c17-b165-cda5c3ebf5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a06796b9-611f-43d4-938f-77007c46d173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a06796b9-611f-43d4-938f-77007c46d173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1235322967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cebb7119-c85c-4dc0-b552-958cba828a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b1783daaac402391b581a2d15eb8b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:23Z,use_quota=True,user_id='11df632b36f644a98cb9decc165fa02c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a024996d-3798-44f2-8f0b-c80686e5ef34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a024996d-3798-44f2-8f0b-c80686e5ef34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e80965e-7df9-4fd6-956a-537dd6938da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e80965e-7df9-4fd6-956a-537dd6938da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cebb7119-c85c-4dc0-b552-958cba828a24', 'volume_name': 'volume-cebb7119-c85c-4dc0-b552-958cba828a24', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878e0960-97e4-4261-8a88-b8181560e64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878e0960-97e4-4261-8a88-b8181560e64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bea96e-e288-4990-8d01-6673845b7639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:23 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Volume cebb7119-c85c-4dc0-b552-958cba828a24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cebb7119-c85c-4dc0-b552-958cba828a24', 'volume_size': 1} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:23 devstack sudo[83472]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609" returned: 0 in 1.422s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] <== create_volume: return (3924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.929s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.491s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1235322967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cebb7119-c85c-4dc0-b552-958cba828a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b1783daaac402391b581a2d15eb8b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:23Z,use_quota=True,user_id='11df632b36f644a98cb9decc165fa02c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Creating volume cebb7119-c85c-4dc0-b552-958cba828a24 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:01:23 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cebb7119-c85c-4dc0-b552-958cba828a24 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:23 devstack sudo[83476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cebb7119-c85c-4dc0-b552-958cba828a24 1073741824 Feb 27 02:01:23 devstack sudo[83476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f372b458-d835-451d-b414-e2dfdd6d3978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd3ee1d1-5390-4d34-964a-a02909622609', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85434f2d-743d-4915-8746-dfa40162e68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:23 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Volume volume-bd3ee1d1-5390-4d34-964a-a02909622609 (bd3ee1d1-5390-4d34-964a-a02909622609): created successfully Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85434f2d-743d-4915-8746-dfa40162e68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Flow 'volume_create_manager' (e008b272-47c0-49f7-a237-7abb9321c081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:01:23 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-cb008a06-2f83-4e07-bb16-73f29ebe541c tempest-GroupSnapshotsV319Test-1551701714 None] Created volume successfully. Feb 27 02:01:24 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] GroupSnapshot b04a4a35-087b-4ec3-bd89-2198e607ccb6: creating. Feb 27 02:01:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] Group snapshot b04a4a35-087b-4ec3-bd89-2198e607ccb6: creating. {{(pid=82683) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 02:01:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:25 devstack sudo[83476]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cebb7119-c85c-4dc0-b552-958cba828a24 1073741824" returned: 0 in 1.637s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cebb7119-c85c-4dc0-b552-958cba828a24 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:25 devstack sudo[83483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cebb7119-c85c-4dc0-b552-958cba828a24 Feb 27 02:01:25 devstack sudo[83483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:26 devstack sudo[83483]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cebb7119-c85c-4dc0-b552-958cba828a24" returned: 0 in 0.696s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:26 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] <== create_volume: return (2397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:01:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.403s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.154s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:26 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] Creating offline snapshot df368ca9-447a-42a7-8f3e-044d124c9675 of volume bd3ee1d1-5390-4d34-964a-a02909622609 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:01:26 devstack cinder-volume[82683]: INFO oslo.privsep.daemon [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpvmqf_4il/privsep.sock'] Feb 27 02:01:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bea96e-e288-4990-8d01-6673845b7639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cebb7119-c85c-4dc0-b552-958cba828a24', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445a7727-3236-41f5-9116-8db8ed44d96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:26 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Volume volume-cebb7119-c85c-4dc0-b552-958cba828a24 (cebb7119-c85c-4dc0-b552-958cba828a24): created successfully Feb 27 02:01:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445a7727-3236-41f5-9116-8db8ed44d96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:26 devstack sudo[83506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpvmqf_4il/privsep.sock Feb 27 02:01:26 devstack sudo[83506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Flow 'volume_create_manager' (5248b046-4ead-4c17-b165-cda5c3ebf5be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:01:26 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-c70abe42-6eca-487c-b370-9c6e328f7872 tempest-VolumesAdminNegativeTest-132222072 None] Created volume successfully. Feb 27 02:01:27 devstack sudo[83506]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:27 devstack cinder-volume[82683]: INFO oslo.privsep.daemon [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] Spawned new privsep daemon via rootwrap Feb 27 02:01:27 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] Accepted privsep connection to /tmp/tmpvmqf_4il/privsep.sock {{(pid=82683) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Feb 27 02:01:27 devstack cinder-volume[82683]: INFO oslo.privsep.daemon [-] privsep daemon starting Feb 27 02:01:27 devstack cinder-volume[82683]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Feb 27 02:01:27 devstack cinder-volume[82683]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Feb 27 02:01:27 devstack cinder-volume[82683]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83512 Feb 27 02:01:27 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac324f2-5377-4ab7-9543-79bcab6eb695]: (2,) {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:01:27 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fa62fb-6b85-4350-95b4-aac5219b96f4]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:01:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:27 devstack sudo[83520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609 Feb 27 02:01:27 devstack sudo[83520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] Acquiring lock "cinder-cebb7119-c85c-4dc0-b552-958cba828a24-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:01:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] Lock "cinder-cebb7119-c85c-4dc0-b552-958cba828a24-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:01:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] Acquiring lock "cinder-quobyte-cebb7119-c85c-4dc0-b552-958cba828a24" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:01:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] Lock "cinder-quobyte-cebb7119-c85c-4dc0-b552-958cba828a24" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:01:28 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e45d4e-25dc-4b75-a39c-4025de7cce1a]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:01:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cebb7119-c85c-4dc0-b552-958cba828a24 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:28 devstack sudo[83522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cebb7119-c85c-4dc0-b552-958cba828a24 Feb 27 02:01:28 devstack sudo[83522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:28 devstack sudo[83520]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609" returned: 0 in 0.595s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.df368ca9-447a-42a7-8f3e-044d124c9675 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:28 devstack sudo[83528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.df368ca9-447a-42a7-8f3e-044d124c9675 1G Feb 27 02:01:28 devstack sudo[83528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:28 devstack sudo[83522]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cebb7119-c85c-4dc0-b552-958cba828a24" returned: 0 in 0.695s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cebb7119-c85c-4dc0-b552-958cba828a24 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:28 devstack sudo[83536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cebb7119-c85c-4dc0-b552-958cba828a24 Feb 27 02:01:28 devstack sudo[83536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:28 devstack sudo[83528]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.df368ca9-447a-42a7-8f3e-044d124c9675 1G" returned: 0 in 0.560s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd3ee1d1-5390-4d34-964a-a02909622609 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.df368ca9-447a-42a7-8f3e-044d124c9675 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:28 devstack sudo[83538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd3ee1d1-5390-4d34-964a-a02909622609 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.df368ca9-447a-42a7-8f3e-044d124c9675 Feb 27 02:01:28 devstack sudo[83538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:29 devstack sudo[83538]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd3ee1d1-5390-4d34-964a-a02909622609 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.df368ca9-447a-42a7-8f3e-044d124c9675" returned: 0 in 0.754s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:29 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.df368ca9-447a-42a7-8f3e-044d124c9675 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:01:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.df368ca9-447a-42a7-8f3e-044d124c9675 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:29 devstack sudo[83551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.df368ca9-447a-42a7-8f3e-044d124c9675 Feb 27 02:01:29 devstack sudo[83551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:29 devstack sudo[83536]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cebb7119-c85c-4dc0-b552-958cba828a24" returned: 0 in 0.931s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:29 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] Lock "cinder-quobyte-cebb7119-c85c-4dc0-b552-958cba828a24" released by "delete_volume" :: held 1.691s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:01:29 devstack cinder-volume[82683]: WARNING cinder.quota [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:01:29 devstack cinder-volume[82683]: WARNING cinder.quota [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:01:29 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] Created reservations ['463c4f95-ed42-46bd-95fe-35aa492ed253', '20056ade-900b-4f5b-b2e7-7a97b3a89549', '39e566a1-404c-4f53-9971-226a1d391a9b', '3bc2537d-48e9-4e5e-9cd0-e2e950a8e047'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:01:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:29 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:01:29 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:01:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:30 devstack sudo[83554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:01:30 devstack sudo[83554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:30 devstack sudo[83551]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.df368ca9-447a-42a7-8f3e-044d124c9675" returned: 0 in 0.592s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:30 devstack sudo[83557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.info Feb 27 02:01:30 devstack sudo[83557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:30 devstack sudo[83554]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.627s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:30 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:01:30 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] Deleted volume successfully. Feb 27 02:01:30 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-96a928ef-18f9-4ce5-99ab-0bd506b163ae tempest-VolumesAdminNegativeTest-132222072 None] Lock "cinder-cebb7119-c85c-4dc0-b552-958cba828a24-delete_volume" released by "delete_volume" :: held 2.745s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:01:30 devstack sudo[83557]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.info" returned: 0 in 0.705s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:30 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:01:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:30 devstack sudo[83561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.info Feb 27 02:01:30 devstack sudo[83561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:31 devstack sudo[83561]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.info" returned: 0 in 0.637s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.356s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:31 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-6c6e00ab-8b36-4f1a-a1c7-e5ad53a40f49 tempest-GroupSnapshotsV319Test-1551701714 None] group_snapshot b04a4a35-087b-4ec3-bd89-2198e607ccb6: created successfully Feb 27 02:01:33 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] group_snapshot b04a4a35-087b-4ec3-bd89-2198e607ccb6: deleting Feb 27 02:01:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] group_snapshot b04a4a35-087b-4ec3-bd89-2198e607ccb6: deleting {{(pid=82683) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 02:01:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] Acquiring lock "cinder-quobyte-bd3ee1d1-5390-4d34-964a-a02909622609" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:01:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] Lock "cinder-quobyte-bd3ee1d1-5390-4d34-964a-a02909622609" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:01:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] Acquiring lock "cinder-quobyte-df368ca9-447a-42a7-8f3e-044d124c9675" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:01:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] Lock "cinder-quobyte-df368ca9-447a-42a7-8f3e-044d124c9675" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:01:33 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] Deleting offline snapshot df368ca9-447a-42a7-8f3e-044d124c9675 of volume bd3ee1d1-5390-4d34-964a-a02909622609 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:01:33 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] snapshot_file for this snap is: volume-bd3ee1d1-5390-4d34-964a-a02909622609.df368ca9-447a-42a7-8f3e-044d124c9675 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:01:33 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0b5986-fcb2-4381-bd26-f33e622a1058]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:01:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.df368ca9-447a-42a7-8f3e-044d124c9675 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:33 devstack sudo[83626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.df368ca9-447a-42a7-8f3e-044d124c9675 Feb 27 02:01:33 devstack sudo[83626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:34 devstack sudo[83626]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.df368ca9-447a-42a7-8f3e-044d124c9675" returned: 0 in 1.246s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:34 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd3ee1d1-5390-4d34-964a-a02909622609(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:01:34 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c976a2f-e5c9-4939-b077-bc20862dda75]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:01:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:35 devstack sudo[83653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609 Feb 27 02:01:35 devstack sudo[83653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Flow 'volume_create_manager' (603fb087-166e-4ee4-af23-ece3aa111ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d92d74-b38b-4b46-b530-88ffa2ef4e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d92d74-b38b-4b46-b530-88ffa2ef4e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1327733532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260f9ea4-aa7e-4f32-92f2-930a41b41ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52c2ac114bf6448fb6db9e18db254ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:35Z,use_quota=True,user_id='9a27dee368b5443f900a5bb8fc91fd37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f8d206a-f99b-42e3-9206-4c2d5c67f8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f8d206a-f99b-42e3-9206-4c2d5c67f8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c396d1-2254-4a81-93b7-717cf2f0847b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c396d1-2254-4a81-93b7-717cf2f0847b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '260f9ea4-aa7e-4f32-92f2-930a41b41ed0', 'volume_name': 'volume-260f9ea4-aa7e-4f32-92f2-930a41b41ed0', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40cc5eff-2b80-4d7b-9ff3-763eeaf18b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40cc5eff-2b80-4d7b-9ff3-763eeaf18b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (468a0d60-7e3f-47a1-ae7b-9ac0dba43c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:35 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Volume 260f9ea4-aa7e-4f32-92f2-930a41b41ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-260f9ea4-aa7e-4f32-92f2-930a41b41ed0', 'volume_size': 1} Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1327733532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260f9ea4-aa7e-4f32-92f2-930a41b41ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52c2ac114bf6448fb6db9e18db254ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:35Z,use_quota=True,user_id='9a27dee368b5443f900a5bb8fc91fd37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Creating volume 260f9ea4-aa7e-4f32-92f2-930a41b41ed0 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:01:35 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-260f9ea4-aa7e-4f32-92f2-930a41b41ed0 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:35 devstack sudo[83656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-260f9ea4-aa7e-4f32-92f2-930a41b41ed0 1073741824 Feb 27 02:01:35 devstack sudo[83656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:35 devstack sudo[83653]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609" returned: 0 in 0.943s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.df368ca9-447a-42a7-8f3e-044d124c9675 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:35 devstack sudo[83661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.df368ca9-447a-42a7-8f3e-044d124c9675 Feb 27 02:01:35 devstack sudo[83661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:36 devstack sudo[83656]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-260f9ea4-aa7e-4f32-92f2-930a41b41ed0 1073741824" returned: 0 in 0.645s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-260f9ea4-aa7e-4f32-92f2-930a41b41ed0 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:36 devstack sudo[83666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-260f9ea4-aa7e-4f32-92f2-930a41b41ed0 Feb 27 02:01:36 devstack sudo[83666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:36 devstack sudo[83661]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.df368ca9-447a-42a7-8f3e-044d124c9675" returned: 0 in 0.754s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.df368ca9-447a-42a7-8f3e-044d124c9675 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:36 devstack sudo[83671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.df368ca9-447a-42a7-8f3e-044d124c9675 Feb 27 02:01:36 devstack sudo[83671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:36 devstack sudo[83666]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-260f9ea4-aa7e-4f32-92f2-930a41b41ed0" returned: 0 in 0.574s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:36 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:01:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (468a0d60-7e3f-47a1-ae7b-9ac0dba43c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-260f9ea4-aa7e-4f32-92f2-930a41b41ed0', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c80e71-4daf-4469-9c42-524f0bf48046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:36 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Volume volume-260f9ea4-aa7e-4f32-92f2-930a41b41ed0 (260f9ea4-aa7e-4f32-92f2-930a41b41ed0): created successfully Feb 27 02:01:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c80e71-4daf-4469-9c42-524f0bf48046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Flow 'volume_create_manager' (603fb087-166e-4ee4-af23-ece3aa111ec6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:01:36 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-7ccbebdc-88fe-4d9a-8a78-8d76accd32a5 tempest-ServerRescueNegativeTestJSON-123759809 None] Created volume successfully. Feb 27 02:01:37 devstack sudo[83671]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609.df368ca9-447a-42a7-8f3e-044d124c9675" returned: 0 in 0.658s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:37 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] Lock "cinder-quobyte-df368ca9-447a-42a7-8f3e-044d124c9675" released by "_delete_snapshot" :: held 3.877s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:01:37 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] Lock "cinder-quobyte-bd3ee1d1-5390-4d34-964a-a02909622609" released by "delete_snapshot" :: held 3.900s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:01:37 devstack cinder-volume[82683]: WARNING cinder.quota [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1327244820 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1327244820, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:01:37 devstack cinder-volume[82683]: WARNING cinder.quota [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1327244820 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1327244820, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:01:37 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] Created reservations ['3cbdd876-9b4e-4ffb-8913-778a20c56ce4', '3aa719ac-8600-4ab8-8329-8ca2e8eeb851', '10203c06-0442-4ed3-b1e6-416a19442c38', '22d8b16b-2e60-4f5e-b9bb-993f54712f97'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:01:37 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-4a53e4ce-b1ec-4628-b2d1-22ba2449a7bb tempest-GroupSnapshotsV319Test-1551701714 None] group_snapshot b04a4a35-087b-4ec3-bd89-2198e607ccb6: deleted successfully Feb 27 02:01:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-41cc8b07-b07e-4753-b271-d32fad577d04 tempest-GroupSnapshotsV319Test-1551701714 None] Acquiring lock "cinder-quobyte-bd3ee1d1-5390-4d34-964a-a02909622609" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:01:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-41cc8b07-b07e-4753-b271-d32fad577d04 tempest-GroupSnapshotsV319Test-1551701714 None] Lock "cinder-quobyte-bd3ee1d1-5390-4d34-964a-a02909622609" acquired by "delete_volume" :: waited 0.015s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:01:38 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95c33ce-73c9-4a52-a763-785725182473]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:01:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-41cc8b07-b07e-4753-b271-d32fad577d04 tempest-GroupSnapshotsV319Test-1551701714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:38 devstack sudo[83679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609 Feb 27 02:01:38 devstack sudo[83679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:39 devstack sudo[83679]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-41cc8b07-b07e-4753-b271-d32fad577d04 tempest-GroupSnapshotsV319Test-1551701714 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609" returned: 0 in 0.766s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-41cc8b07-b07e-4753-b271-d32fad577d04 tempest-GroupSnapshotsV319Test-1551701714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:39 devstack sudo[83684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609 Feb 27 02:01:39 devstack sudo[83684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:39 devstack sudo[83684]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-41cc8b07-b07e-4753-b271-d32fad577d04 tempest-GroupSnapshotsV319Test-1551701714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd3ee1d1-5390-4d34-964a-a02909622609" returned: 0 in 0.764s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:39 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-41cc8b07-b07e-4753-b271-d32fad577d04 tempest-GroupSnapshotsV319Test-1551701714 None] Lock "cinder-quobyte-bd3ee1d1-5390-4d34-964a-a02909622609" released by "delete_volume" :: held 1.703s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:01:40 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-41cc8b07-b07e-4753-b271-d32fad577d04 tempest-GroupSnapshotsV319Test-1551701714 None] Created reservations ['8aa28230-79c3-478f-bd0b-92902df55617'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:01:40 devstack cinder-volume[82683]: WARNING cinder.quota [None req-41cc8b07-b07e-4753-b271-d32fad577d04 tempest-GroupSnapshotsV319Test-1551701714 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1327244820 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1327244820, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:01:40 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-41cc8b07-b07e-4753-b271-d32fad577d04 tempest-GroupSnapshotsV319Test-1551701714 None] Created reservations ['f41bb4c7-f9a1-4eac-8758-02df8f700605', '04449a63-e092-4799-b466-80a64801bfb3', '2f4aee4f-13b6-4175-aaf7-b9784d063560', 'dc8059df-96c8-4fe1-b71a-4979f91a6e27'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:01:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-41cc8b07-b07e-4753-b271-d32fad577d04 tempest-GroupSnapshotsV319Test-1551701714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-41cc8b07-b07e-4753-b271-d32fad577d04 tempest-GroupSnapshotsV319Test-1551701714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:40 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-41cc8b07-b07e-4753-b271-d32fad577d04 tempest-GroupSnapshotsV319Test-1551701714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:01:40 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-41cc8b07-b07e-4753-b271-d32fad577d04 tempest-GroupSnapshotsV319Test-1551701714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:01:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-41cc8b07-b07e-4753-b271-d32fad577d04 tempest-GroupSnapshotsV319Test-1551701714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-41cc8b07-b07e-4753-b271-d32fad577d04 tempest-GroupSnapshotsV319Test-1551701714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:40 devstack sudo[83714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:01:40 devstack sudo[83714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:41 devstack sudo[83714]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-41cc8b07-b07e-4753-b271-d32fad577d04 tempest-GroupSnapshotsV319Test-1551701714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 1.467s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:41 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-41cc8b07-b07e-4753-b271-d32fad577d04 tempest-GroupSnapshotsV319Test-1551701714 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:01:41 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-41cc8b07-b07e-4753-b271-d32fad577d04 tempest-GroupSnapshotsV319Test-1551701714 None] Delete group completed successfully. Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Flow 'volume_create_manager' (e2aa36e5-312b-4386-90a6-c88fcad621e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1616fa99-c73a-4334-92c8-9168e6295066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1616fa99-c73a-4334-92c8-9168e6295066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-374348696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f921669-957e-4061-8d15-65013ddf8edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ade0279fde9e44019e367c968e25217d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:45Z,use_quota=True,user_id='8d1240e16b15425192e70e0d76eb8169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e547693b-6300-407a-96d8-4fb27c0f46fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e547693b-6300-407a-96d8-4fb27c0f46fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60df9ad-a7b7-4d6d-aebc-3496ee6d5ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60df9ad-a7b7-4d6d-aebc-3496ee6d5ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f921669-957e-4061-8d15-65013ddf8edb', 'volume_name': 'volume-9f921669-957e-4061-8d15-65013ddf8edb', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11909adf-a3ca-4834-8904-2e0f3664ae2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11909adf-a3ca-4834-8904-2e0f3664ae2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c411be4-c41a-4232-a160-63cb2c217d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:45 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Volume 9f921669-957e-4061-8d15-65013ddf8edb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f921669-957e-4061-8d15-65013ddf8edb', 'volume_size': 1} Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-374348696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f921669-957e-4061-8d15-65013ddf8edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ade0279fde9e44019e367c968e25217d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:01:45Z,use_quota=True,user_id='8d1240e16b15425192e70e0d76eb8169',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Creating volume 9f921669-957e-4061-8d15-65013ddf8edb {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:01:45 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:01:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9f921669-957e-4061-8d15-65013ddf8edb 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:45 devstack sudo[83746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9f921669-957e-4061-8d15-65013ddf8edb 1073741824 Feb 27 02:01:45 devstack sudo[83746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:46 devstack sudo[83746]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9f921669-957e-4061-8d15-65013ddf8edb 1073741824" returned: 0 in 1.193s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9f921669-957e-4061-8d15-65013ddf8edb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:46 devstack sudo[83751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9f921669-957e-4061-8d15-65013ddf8edb Feb 27 02:01:46 devstack sudo[83751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:47 devstack sudo[83751]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9f921669-957e-4061-8d15-65013ddf8edb" returned: 0 in 0.928s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:47 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] <== create_volume: return (2176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:01:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.185s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:47 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c411be4-c41a-4232-a160-63cb2c217d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f921669-957e-4061-8d15-65013ddf8edb', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:47 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c094b977-738f-4966-b9ba-041dfdb09605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:01:47 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Volume volume-9f921669-957e-4061-8d15-65013ddf8edb (9f921669-957e-4061-8d15-65013ddf8edb): created successfully Feb 27 02:01:47 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c094b977-738f-4966-b9ba-041dfdb09605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:01:47 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Flow 'volume_create_manager' (e2aa36e5-312b-4386-90a6-c88fcad621e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:01:47 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-a7335f94-5549-46fd-a692-afcb1891d3c6 tempest-DeleteServersTestJSON-1444723552 None] Created volume successfully. Feb 27 02:01:56 devstack cinder-volume[82683]: WARNING py.warnings [req-5386970a-ef48-49b2-91f0-10deddc5b05e req-a727617f-d7cf-4106-850f-e5f83a062ccc tempest-DeleteServersTestJSON-1444723552 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Feb 27 02:01:56 devstack cinder-volume[82683]: .first() Feb 27 02:01:56 devstack cinder-volume[82683]: Feb 27 02:01:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-5386970a-ef48-49b2-91f0-10deddc5b05e req-a727617f-d7cf-4106-850f-e5f83a062ccc tempest-DeleteServersTestJSON-1444723552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:01:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-5386970a-ef48-49b2-91f0-10deddc5b05e req-a727617f-d7cf-4106-850f-e5f83a062ccc tempest-DeleteServersTestJSON-1444723552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:01:56 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f156ddba-ad5d-4ca4-b60b-1ee593841b6f]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:01:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5386970a-ef48-49b2-91f0-10deddc5b05e req-a727617f-d7cf-4106-850f-e5f83a062ccc tempest-DeleteServersTestJSON-1444723552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9f921669-957e-4061-8d15-65013ddf8edb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:56 devstack sudo[83848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9f921669-957e-4061-8d15-65013ddf8edb Feb 27 02:01:56 devstack sudo[83848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:57 devstack sudo[83848]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5386970a-ef48-49b2-91f0-10deddc5b05e req-a727617f-d7cf-4106-850f-e5f83a062ccc tempest-DeleteServersTestJSON-1444723552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9f921669-957e-4061-8d15-65013ddf8edb" returned: 0 in 1.454s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-5386970a-ef48-49b2-91f0-10deddc5b05e req-a727617f-d7cf-4106-850f-e5f83a062ccc tempest-DeleteServersTestJSON-1444723552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.572s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:01:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-5386970a-ef48-49b2-91f0-10deddc5b05e req-a727617f-d7cf-4106-850f-e5f83a062ccc tempest-DeleteServersTestJSON-1444723552 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3', 'name': 'volume-9f921669-957e-4061-8d15-65013ddf8edb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68e0731c-35a0-4ef2-a79f-e10d4485828a', 'enforce_multipath': True} {{(pid=82683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 27 02:01:58 devstack cinder-volume[82683]: INFO cinder.volume.manager [req-5386970a-ef48-49b2-91f0-10deddc5b05e req-a727617f-d7cf-4106-850f-e5f83a062ccc tempest-DeleteServersTestJSON-1444723552 None] attachment_update completed successfully. Feb 27 02:01:58 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d222a23f-402c-4d73-b6b5-08d52e3760d9 tempest-ServerRescueNegativeTestJSON-123759809 None] Acquiring lock "cinder-260f9ea4-aa7e-4f32-92f2-930a41b41ed0-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:01:58 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d222a23f-402c-4d73-b6b5-08d52e3760d9 tempest-ServerRescueNegativeTestJSON-123759809 None] Lock "cinder-260f9ea4-aa7e-4f32-92f2-930a41b41ed0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:01:58 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d222a23f-402c-4d73-b6b5-08d52e3760d9 tempest-ServerRescueNegativeTestJSON-123759809 None] Acquiring lock "cinder-quobyte-260f9ea4-aa7e-4f32-92f2-930a41b41ed0" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:01:58 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d222a23f-402c-4d73-b6b5-08d52e3760d9 tempest-ServerRescueNegativeTestJSON-123759809 None] Lock "cinder-quobyte-260f9ea4-aa7e-4f32-92f2-930a41b41ed0" acquired by "delete_volume" :: waited 0.019s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:01:58 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6476c6d-0678-4094-869a-05a02d6bc34f]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:01:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d222a23f-402c-4d73-b6b5-08d52e3760d9 tempest-ServerRescueNegativeTestJSON-123759809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-260f9ea4-aa7e-4f32-92f2-930a41b41ed0 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:59 devstack sudo[83859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-260f9ea4-aa7e-4f32-92f2-930a41b41ed0 Feb 27 02:01:59 devstack sudo[83859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:01:59 devstack sudo[83859]: pam_unix(sudo:session): session closed for user root Feb 27 02:01:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d222a23f-402c-4d73-b6b5-08d52e3760d9 tempest-ServerRescueNegativeTestJSON-123759809 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-260f9ea4-aa7e-4f32-92f2-930a41b41ed0" returned: 0 in 1.129s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:01:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d222a23f-402c-4d73-b6b5-08d52e3760d9 tempest-ServerRescueNegativeTestJSON-123759809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-260f9ea4-aa7e-4f32-92f2-930a41b41ed0 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:01:59 devstack sudo[83932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-260f9ea4-aa7e-4f32-92f2-930a41b41ed0 Feb 27 02:01:59 devstack sudo[83932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:01 devstack sudo[83932]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d222a23f-402c-4d73-b6b5-08d52e3760d9 tempest-ServerRescueNegativeTestJSON-123759809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-260f9ea4-aa7e-4f32-92f2-930a41b41ed0" returned: 0 in 1.102s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:01 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d222a23f-402c-4d73-b6b5-08d52e3760d9 tempest-ServerRescueNegativeTestJSON-123759809 None] Lock "cinder-quobyte-260f9ea4-aa7e-4f32-92f2-930a41b41ed0" released by "delete_volume" :: held 2.373s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:01 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-d222a23f-402c-4d73-b6b5-08d52e3760d9 tempest-ServerRescueNegativeTestJSON-123759809 None] Created reservations ['d69b9872-e909-4194-906f-db723cafefae', '273e87a6-7478-4760-8e7e-14717f455d5c', '42374a4c-cf24-4675-b3a9-fc7984b80e3f', 'ba240936-ef49-4a49-aa3c-b2ce828f8ab2'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d222a23f-402c-4d73-b6b5-08d52e3760d9 tempest-ServerRescueNegativeTestJSON-123759809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d222a23f-402c-4d73-b6b5-08d52e3760d9 tempest-ServerRescueNegativeTestJSON-123759809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d222a23f-402c-4d73-b6b5-08d52e3760d9 tempest-ServerRescueNegativeTestJSON-123759809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d222a23f-402c-4d73-b6b5-08d52e3760d9 tempest-ServerRescueNegativeTestJSON-123759809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d222a23f-402c-4d73-b6b5-08d52e3760d9 tempest-ServerRescueNegativeTestJSON-123759809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d222a23f-402c-4d73-b6b5-08d52e3760d9 tempest-ServerRescueNegativeTestJSON-123759809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:01 devstack sudo[84252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:02:01 devstack sudo[84252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:02 devstack sudo[84252]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d222a23f-402c-4d73-b6b5-08d52e3760d9 tempest-ServerRescueNegativeTestJSON-123759809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 1.282s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:02 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-d222a23f-402c-4d73-b6b5-08d52e3760d9 tempest-ServerRescueNegativeTestJSON-123759809 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:02 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-d222a23f-402c-4d73-b6b5-08d52e3760d9 tempest-ServerRescueNegativeTestJSON-123759809 None] Deleted volume successfully. Feb 27 02:02:02 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d222a23f-402c-4d73-b6b5-08d52e3760d9 tempest-ServerRescueNegativeTestJSON-123759809 None] Lock "cinder-260f9ea4-aa7e-4f32-92f2-930a41b41ed0-delete_volume" released by "delete_volume" :: held 4.030s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Flow 'volume_create_manager' (91771f6c-8616-47f5-99dc-5e8a9183ddc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c54a6ea-9258-466a-9f7f-de1a9d66f75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c54a6ea-9258-466a-9f7f-de1a9d66f75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-572751091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36c721e-dff4-4cab-b14d-7b5e089a6064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47719ed8a9647f89123250f23bb85e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:07Z,use_quota=True,user_id='222897189e9c4b45b4b3288a62eff9b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c71c5c4-288b-47ee-adec-7c56c12ae3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c71c5c4-288b-47ee-adec-7c56c12ae3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40a2b15-9c57-486c-92d8-f1433be38faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e40a2b15-9c57-486c-92d8-f1433be38faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e36c721e-dff4-4cab-b14d-7b5e089a6064', 'volume_name': 'volume-e36c721e-dff4-4cab-b14d-7b5e089a6064', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07187188-0e0e-4ebc-a688-49fde9a578ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07187188-0e0e-4ebc-a688-49fde9a578ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d898c1-1f26-4e67-8f39-305b2e9f8af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:06 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Volume e36c721e-dff4-4cab-b14d-7b5e089a6064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e36c721e-dff4-4cab-b14d-7b5e089a6064', 'volume_size': 1} Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-572751091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36c721e-dff4-4cab-b14d-7b5e089a6064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47719ed8a9647f89123250f23bb85e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:07Z,use_quota=True,user_id='222897189e9c4b45b4b3288a62eff9b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Creating volume e36c721e-dff4-4cab-b14d-7b5e089a6064 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:02:06 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:02:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:06 devstack sudo[84363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064 1073741824 Feb 27 02:02:06 devstack sudo[84363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:07 devstack sudo[84363]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064 1073741824" returned: 0 in 0.651s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:07 devstack sudo[84368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064 Feb 27 02:02:07 devstack sudo[84368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:08 devstack sudo[84368]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064" returned: 0 in 0.555s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:08 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:02:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:08 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d898c1-1f26-4e67-8f39-305b2e9f8af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e36c721e-dff4-4cab-b14d-7b5e089a6064', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:08 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe76956c-158d-405b-baa1-0c1ee57a57bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:08 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:SELECT=50,cinder:UPDATE=62,cinder:DELETE=6,cinder:INSERT=14 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:02:08 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Volume volume-e36c721e-dff4-4cab-b14d-7b5e089a6064 (e36c721e-dff4-4cab-b14d-7b5e089a6064): created successfully Feb 27 02:02:08 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe76956c-158d-405b-baa1-0c1ee57a57bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:08 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Flow 'volume_create_manager' (91771f6c-8616-47f5-99dc-5e8a9183ddc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:08 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-a9d130ce-b484-40c7-b3b1-2d6c9486627c tempest-SnapshotMetadataTestJSON-69314670 None] Created volume successfully. Feb 27 02:02:08 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:UPDATE=43,cinder:SELECT=49,cinder:INSERT=9,cinder:DELETE=1 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:02:08 devstack cinder-volume[82683]: INFO cinder.volume.manager [req-97f093a7-cb06-4343-b116-faafcb35afb3 req-23754291-89d3-4acd-984c-420a8d9ffddf tempest-DeleteServersTestJSON-1444723552 None] Terminate volume connection completed successfully. Feb 27 02:02:08 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-97f093a7-cb06-4343-b116-faafcb35afb3 req-23754291-89d3-4acd-984c-420a8d9ffddf tempest-DeleteServersTestJSON-1444723552 None] Deleting attachment 68e0731c-35a0-4ef2-a79f-e10d4485828a. {{(pid=82683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 27 02:02:09 devstack cinder-volume[82683]: DEBUG oslo_service.periodic_task [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:02:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:09 devstack sudo[84380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:02:09 devstack sudo[84380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3868c094-bf16-4239-bc78-8f36251903be tempest-SnapshotMetadataTestJSON-69314670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3868c094-bf16-4239-bc78-8f36251903be tempest-SnapshotMetadataTestJSON-69314670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-3868c094-bf16-4239-bc78-8f36251903be tempest-SnapshotMetadataTestJSON-69314670 None] Creating offline snapshot da4929fd-2aaf-415c-9a75-0f7b9cc1c699 of volume e36c721e-dff4-4cab-b14d-7b5e089a6064 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:02:09 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6291d5-7c4f-499a-9f08-afced2070012]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3868c094-bf16-4239-bc78-8f36251903be tempest-SnapshotMetadataTestJSON-69314670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:09 devstack sudo[84382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064 Feb 27 02:02:09 devstack sudo[84382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:10 devstack sudo[84380]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.631s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:10 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:10 devstack sudo[84382]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3868c094-bf16-4239-bc78-8f36251903be tempest-SnapshotMetadataTestJSON-69314670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064" returned: 0 in 0.867s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3868c094-bf16-4239-bc78-8f36251903be tempest-SnapshotMetadataTestJSON-69314670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.da4929fd-2aaf-415c-9a75-0f7b9cc1c699 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:10 devstack sudo[84396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.da4929fd-2aaf-415c-9a75-0f7b9cc1c699 1G Feb 27 02:02:10 devstack sudo[84396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:11 devstack sudo[84396]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3868c094-bf16-4239-bc78-8f36251903be tempest-SnapshotMetadataTestJSON-69314670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.da4929fd-2aaf-415c-9a75-0f7b9cc1c699 1G" returned: 0 in 0.810s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3868c094-bf16-4239-bc78-8f36251903be tempest-SnapshotMetadataTestJSON-69314670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e36c721e-dff4-4cab-b14d-7b5e089a6064 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.da4929fd-2aaf-415c-9a75-0f7b9cc1c699 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:11 devstack sudo[84419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e36c721e-dff4-4cab-b14d-7b5e089a6064 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.da4929fd-2aaf-415c-9a75-0f7b9cc1c699 Feb 27 02:02:11 devstack sudo[84419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:11 devstack sudo[84419]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3868c094-bf16-4239-bc78-8f36251903be tempest-SnapshotMetadataTestJSON-69314670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e36c721e-dff4-4cab-b14d-7b5e089a6064 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.da4929fd-2aaf-415c-9a75-0f7b9cc1c699" returned: 0 in 0.691s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:11 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-3868c094-bf16-4239-bc78-8f36251903be tempest-SnapshotMetadataTestJSON-69314670 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.da4929fd-2aaf-415c-9a75-0f7b9cc1c699 is being set with open permissions: ugo+rw Feb 27 02:02:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3868c094-bf16-4239-bc78-8f36251903be tempest-SnapshotMetadataTestJSON-69314670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.da4929fd-2aaf-415c-9a75-0f7b9cc1c699 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:11 devstack sudo[84424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.da4929fd-2aaf-415c-9a75-0f7b9cc1c699 Feb 27 02:02:11 devstack sudo[84424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:12 devstack sudo[84424]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3868c094-bf16-4239-bc78-8f36251903be tempest-SnapshotMetadataTestJSON-69314670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.da4929fd-2aaf-415c-9a75-0f7b9cc1c699" returned: 0 in 0.660s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3868c094-bf16-4239-bc78-8f36251903be tempest-SnapshotMetadataTestJSON-69314670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:12 devstack sudo[84427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.info Feb 27 02:02:12 devstack sudo[84427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5cc45b66-3851-4b12-985c-59f07bbd942c tempest-DeleteServersTestJSON-1444723552 None] Acquiring lock "cinder-9f921669-957e-4061-8d15-65013ddf8edb-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5cc45b66-3851-4b12-985c-59f07bbd942c tempest-DeleteServersTestJSON-1444723552 None] Lock "cinder-9f921669-957e-4061-8d15-65013ddf8edb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5cc45b66-3851-4b12-985c-59f07bbd942c tempest-DeleteServersTestJSON-1444723552 None] Acquiring lock "cinder-quobyte-9f921669-957e-4061-8d15-65013ddf8edb" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5cc45b66-3851-4b12-985c-59f07bbd942c tempest-DeleteServersTestJSON-1444723552 None] Lock "cinder-quobyte-9f921669-957e-4061-8d15-65013ddf8edb" acquired by "delete_volume" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:12 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b8c57d-d422-4623-958c-effef78a7ca7]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5cc45b66-3851-4b12-985c-59f07bbd942c tempest-DeleteServersTestJSON-1444723552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9f921669-957e-4061-8d15-65013ddf8edb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:13 devstack sudo[84430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9f921669-957e-4061-8d15-65013ddf8edb Feb 27 02:02:13 devstack sudo[84430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:13 devstack sudo[84427]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3868c094-bf16-4239-bc78-8f36251903be tempest-SnapshotMetadataTestJSON-69314670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.info" returned: 0 in 0.624s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:13 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-3868c094-bf16-4239-bc78-8f36251903be tempest-SnapshotMetadataTestJSON-69314670 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.info is being set with open permissions: ugo+rw Feb 27 02:02:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3868c094-bf16-4239-bc78-8f36251903be tempest-SnapshotMetadataTestJSON-69314670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:13 devstack sudo[84433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.info Feb 27 02:02:13 devstack sudo[84433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:13 devstack sudo[84430]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5cc45b66-3851-4b12-985c-59f07bbd942c tempest-DeleteServersTestJSON-1444723552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9f921669-957e-4061-8d15-65013ddf8edb" returned: 0 in 0.842s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5cc45b66-3851-4b12-985c-59f07bbd942c tempest-DeleteServersTestJSON-1444723552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9f921669-957e-4061-8d15-65013ddf8edb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:13 devstack sudo[84439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9f921669-957e-4061-8d15-65013ddf8edb Feb 27 02:02:13 devstack sudo[84439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:13 devstack sudo[84433]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3868c094-bf16-4239-bc78-8f36251903be tempest-SnapshotMetadataTestJSON-69314670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.info" returned: 0 in 0.617s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3868c094-bf16-4239-bc78-8f36251903be tempest-SnapshotMetadataTestJSON-69314670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.411s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:13 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-3868c094-bf16-4239-bc78-8f36251903be tempest-SnapshotMetadataTestJSON-69314670 None] Create snapshot completed successfully Feb 27 02:02:14 devstack sudo[84439]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5cc45b66-3851-4b12-985c-59f07bbd942c tempest-DeleteServersTestJSON-1444723552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9f921669-957e-4061-8d15-65013ddf8edb" returned: 0 in 0.599s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:14 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5cc45b66-3851-4b12-985c-59f07bbd942c tempest-DeleteServersTestJSON-1444723552 None] Lock "cinder-quobyte-9f921669-957e-4061-8d15-65013ddf8edb" released by "delete_volume" :: held 1.484s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:14 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-5cc45b66-3851-4b12-985c-59f07bbd942c tempest-DeleteServersTestJSON-1444723552 None] Created reservations ['36d67fbb-12ee-4912-ade5-c7835dfa3548', 'a70b12d8-259d-4681-9c8d-74589421fb08', 'f22d1f3c-bcec-4d75-90bf-e81285cd4f5e', '6d563bce-0ce8-4beb-97c3-a805aeff778c'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5cc45b66-3851-4b12-985c-59f07bbd942c tempest-DeleteServersTestJSON-1444723552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5cc45b66-3851-4b12-985c-59f07bbd942c tempest-DeleteServersTestJSON-1444723552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5cc45b66-3851-4b12-985c-59f07bbd942c tempest-DeleteServersTestJSON-1444723552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5cc45b66-3851-4b12-985c-59f07bbd942c tempest-DeleteServersTestJSON-1444723552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5cc45b66-3851-4b12-985c-59f07bbd942c tempest-DeleteServersTestJSON-1444723552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5cc45b66-3851-4b12-985c-59f07bbd942c tempest-DeleteServersTestJSON-1444723552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:14 devstack sudo[84442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:02:14 devstack sudo[84442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:15 devstack sudo[84442]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5cc45b66-3851-4b12-985c-59f07bbd942c tempest-DeleteServersTestJSON-1444723552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.844s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:15 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-5cc45b66-3851-4b12-985c-59f07bbd942c tempest-DeleteServersTestJSON-1444723552 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:15 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-5cc45b66-3851-4b12-985c-59f07bbd942c tempest-DeleteServersTestJSON-1444723552 None] Deleted volume successfully. Feb 27 02:02:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5cc45b66-3851-4b12-985c-59f07bbd942c tempest-DeleteServersTestJSON-1444723552 None] Lock "cinder-9f921669-957e-4061-8d15-65013ddf8edb-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] Acquiring lock "cinder-da4929fd-2aaf-415c-9a75-0f7b9cc1c699-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] Lock "cinder-da4929fd-2aaf-415c-9a75-0f7b9cc1c699-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] Acquiring lock "cinder-quobyte-e36c721e-dff4-4cab-b14d-7b5e089a6064" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] Lock "cinder-quobyte-e36c721e-dff4-4cab-b14d-7b5e089a6064" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] Acquiring lock "cinder-quobyte-da4929fd-2aaf-415c-9a75-0f7b9cc1c699" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] Lock "cinder-quobyte-da4929fd-2aaf-415c-9a75-0f7b9cc1c699" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:15 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] Deleting offline snapshot da4929fd-2aaf-415c-9a75-0f7b9cc1c699 of volume e36c721e-dff4-4cab-b14d-7b5e089a6064 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:02:15 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] snapshot_file for this snap is: volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.da4929fd-2aaf-415c-9a75-0f7b9cc1c699 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:02:15 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0184d04-7ae4-43fa-b463-000b3cf9882e]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.da4929fd-2aaf-415c-9a75-0f7b9cc1c699 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:15 devstack sudo[84445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.da4929fd-2aaf-415c-9a75-0f7b9cc1c699 Feb 27 02:02:15 devstack sudo[84445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:16 devstack sudo[84445]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.da4929fd-2aaf-415c-9a75-0f7b9cc1c699" returned: 0 in 0.696s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e36c721e-dff4-4cab-b14d-7b5e089a6064(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:02:16 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c892a6f-5994-413a-a700-f689b0869ec2]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:16 devstack sudo[84450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064 Feb 27 02:02:16 devstack sudo[84450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:16 devstack sudo[84450]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064" returned: 0 in 0.742s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.da4929fd-2aaf-415c-9a75-0f7b9cc1c699 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:17 devstack sudo[84456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.da4929fd-2aaf-415c-9a75-0f7b9cc1c699 Feb 27 02:02:17 devstack sudo[84456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:17 devstack sudo[84456]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.da4929fd-2aaf-415c-9a75-0f7b9cc1c699" returned: 0 in 0.643s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.da4929fd-2aaf-415c-9a75-0f7b9cc1c699 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:17 devstack sudo[84464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.da4929fd-2aaf-415c-9a75-0f7b9cc1c699 Feb 27 02:02:17 devstack sudo[84464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:18 devstack sudo[84464]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064.da4929fd-2aaf-415c-9a75-0f7b9cc1c699" returned: 0 in 0.550s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] Lock "cinder-quobyte-da4929fd-2aaf-415c-9a75-0f7b9cc1c699" released by "_delete_snapshot" :: held 2.742s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] Lock "cinder-quobyte-e36c721e-dff4-4cab-b14d-7b5e089a6064" released by "delete_snapshot" :: held 2.765s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:18 devstack cinder-volume[82683]: WARNING cinder.quota [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:02:18 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] Created reservations ['b6daf946-b4d4-4d45-81eb-d710e4833880', '6cf382e0-ec2f-433f-8c6b-8068d5d83256', 'f64e22c4-57a7-41ec-8b4d-0dd2b90e8a6f', 'f5eab518-4e90-478c-8072-88e6d206fb4b'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:18 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] Delete snapshot completed successfully. Feb 27 02:02:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-36d668ec-4e93-4cbc-b946-7bf5811c1e10 tempest-SnapshotMetadataTestJSON-69314670 None] Lock "cinder-da4929fd-2aaf-415c-9a75-0f7b9cc1c699-delete_snapshot" released by "delete_snapshot" :: held 2.885s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-766c908d-31e4-4423-b54c-be597b63fe51 tempest-SnapshotMetadataTestJSON-69314670 None] Acquiring lock "cinder-e36c721e-dff4-4cab-b14d-7b5e089a6064-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-766c908d-31e4-4423-b54c-be597b63fe51 tempest-SnapshotMetadataTestJSON-69314670 None] Lock "cinder-e36c721e-dff4-4cab-b14d-7b5e089a6064-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-766c908d-31e4-4423-b54c-be597b63fe51 tempest-SnapshotMetadataTestJSON-69314670 None] Acquiring lock "cinder-quobyte-e36c721e-dff4-4cab-b14d-7b5e089a6064" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-766c908d-31e4-4423-b54c-be597b63fe51 tempest-SnapshotMetadataTestJSON-69314670 None] Lock "cinder-quobyte-e36c721e-dff4-4cab-b14d-7b5e089a6064" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:18 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4810f6-f56d-42d7-be8c-e551fee37d78]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-766c908d-31e4-4423-b54c-be597b63fe51 tempest-SnapshotMetadataTestJSON-69314670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:18 devstack sudo[84469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064 Feb 27 02:02:18 devstack sudo[84469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:19 devstack sudo[84469]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-766c908d-31e4-4423-b54c-be597b63fe51 tempest-SnapshotMetadataTestJSON-69314670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064" returned: 0 in 0.667s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-766c908d-31e4-4423-b54c-be597b63fe51 tempest-SnapshotMetadataTestJSON-69314670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:19 devstack sudo[84475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064 Feb 27 02:02:19 devstack sudo[84475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:19 devstack sudo[84475]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-766c908d-31e4-4423-b54c-be597b63fe51 tempest-SnapshotMetadataTestJSON-69314670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e36c721e-dff4-4cab-b14d-7b5e089a6064" returned: 0 in 0.467s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:19 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-766c908d-31e4-4423-b54c-be597b63fe51 tempest-SnapshotMetadataTestJSON-69314670 None] Lock "cinder-quobyte-e36c721e-dff4-4cab-b14d-7b5e089a6064" released by "delete_volume" :: held 1.186s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:19 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-766c908d-31e4-4423-b54c-be597b63fe51 tempest-SnapshotMetadataTestJSON-69314670 None] Created reservations ['610e004f-bbb2-4e3d-b871-cf3ab655871a', '69a6f57a-7483-40d0-b537-7e85bc7c1616', '1bf5f551-3126-49ca-9d3e-4ec418caf8e3', '06438fd2-a83a-4730-b138-7e13a261f5fb'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-766c908d-31e4-4423-b54c-be597b63fe51 tempest-SnapshotMetadataTestJSON-69314670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-766c908d-31e4-4423-b54c-be597b63fe51 tempest-SnapshotMetadataTestJSON-69314670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-766c908d-31e4-4423-b54c-be597b63fe51 tempest-SnapshotMetadataTestJSON-69314670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-766c908d-31e4-4423-b54c-be597b63fe51 tempest-SnapshotMetadataTestJSON-69314670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-766c908d-31e4-4423-b54c-be597b63fe51 tempest-SnapshotMetadataTestJSON-69314670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-766c908d-31e4-4423-b54c-be597b63fe51 tempest-SnapshotMetadataTestJSON-69314670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:20 devstack sudo[84478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:02:20 devstack sudo[84478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:20 devstack sudo[84478]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-766c908d-31e4-4423-b54c-be597b63fe51 tempest-SnapshotMetadataTestJSON-69314670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.571s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:20 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-766c908d-31e4-4423-b54c-be597b63fe51 tempest-SnapshotMetadataTestJSON-69314670 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:20 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-766c908d-31e4-4423-b54c-be597b63fe51 tempest-SnapshotMetadataTestJSON-69314670 None] Deleted volume successfully. Feb 27 02:02:20 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-766c908d-31e4-4423-b54c-be597b63fe51 tempest-SnapshotMetadataTestJSON-69314670 None] Lock "cinder-e36c721e-dff4-4cab-b14d-7b5e089a6064-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Flow 'volume_create_manager' (0d000e09-3791-4503-81ed-e5a295396993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8a5f88-964f-40a0-a565-a357b9539284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8a5f88-964f-40a0-a565-a357b9539284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-734376091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa9de33-7af1-4d4b-b97d-b13b84ec0aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6998ea3a7fb74e608396d9b263e5b994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:24Z,use_quota=True,user_id='72dbcfd70e744ae3959e501a93f08bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0606494d-87ae-4958-91f9-0e4486dfc1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0606494d-87ae-4958-91f9-0e4486dfc1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6adbbc62-df93-491e-8f24-e9d0b34d2e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6adbbc62-df93-491e-8f24-e9d0b34d2e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaa9de33-7af1-4d4b-b97d-b13b84ec0aba', 'volume_name': 'volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf79982-3cf0-405b-b4a9-40926243d5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf79982-3cf0-405b-b4a9-40926243d5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da60ea7-44dc-4034-9543-9a85ca6c36e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:24 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Volume eaa9de33-7af1-4d4b-b97d-b13b84ec0aba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba', 'volume_size': 1} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-734376091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa9de33-7af1-4d4b-b97d-b13b84ec0aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6998ea3a7fb74e608396d9b263e5b994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:24Z,use_quota=True,user_id='72dbcfd70e744ae3959e501a93f08bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Creating volume eaa9de33-7af1-4d4b-b97d-b13b84ec0aba {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:02:24 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:24 devstack sudo[84493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba 1073741824 Feb 27 02:02:24 devstack sudo[84493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Flow 'volume_create_manager' (48a22974-18f1-4299-bcee-e062e8a35f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4baa6a4-f730-490d-922c-e2ce6ca74786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4baa6a4-f730-490d-922c-e2ce6ca74786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1230147563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6969635e-e7c1-435d-9056-8834d35b3df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a8c578ce344040b793e73acec6389b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:25Z,use_quota=True,user_id='43dbb448e49449ae8355ffcf75e4bd4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9009d2-4fed-4b1a-a72f-961dd4d67b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9009d2-4fed-4b1a-a72f-961dd4d67b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59ec893-8881-479f-a365-8844c5fa6c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e59ec893-8881-479f-a365-8844c5fa6c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6969635e-e7c1-435d-9056-8834d35b3df7', 'volume_name': 'volume-6969635e-e7c1-435d-9056-8834d35b3df7', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298af0c8-0400-497a-a9b3-eb7262fc03fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298af0c8-0400-497a-a9b3-eb7262fc03fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc42162b-5030-4374-a581-3db5d4799fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:24 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Volume 6969635e-e7c1-435d-9056-8834d35b3df7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6969635e-e7c1-435d-9056-8834d35b3df7', 'volume_size': 1} Feb 27 02:02:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:24 devstack sudo[84493]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba 1073741824" returned: 0 in 0.776s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:25 devstack sudo[84505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba Feb 27 02:02:25 devstack sudo[84505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:25 devstack sudo[84505]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba" returned: 0 in 0.483s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:25 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:02:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.570s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:25 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1230147563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6969635e-e7c1-435d-9056-8834d35b3df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a8c578ce344040b793e73acec6389b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:25Z,use_quota=True,user_id='43dbb448e49449ae8355ffcf75e4bd4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:02:25 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Creating volume 6969635e-e7c1-435d-9056-8834d35b3df7 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:02:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:25 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:25 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:25 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:02:25 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:02:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8da60ea7-44dc-4034-9543-9a85ca6c36e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78ca317-05fc-4db2-b65c-3cacb84721f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:25 devstack sudo[84509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7 1073741824 Feb 27 02:02:25 devstack sudo[84509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:25 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Volume volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba (eaa9de33-7af1-4d4b-b97d-b13b84ec0aba): created successfully Feb 27 02:02:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78ca317-05fc-4db2-b65c-3cacb84721f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Flow 'volume_create_manager' (0d000e09-3791-4503-81ed-e5a295396993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:25 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-0201a106-99ac-4939-96a2-49dba7260666 tempest-VolumesDeleteCascade-1939462024 None] Created volume successfully. Feb 27 02:02:26 devstack sudo[84509]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7 1073741824" returned: 0 in 0.593s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:26 devstack sudo[84514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7 Feb 27 02:02:26 devstack sudo[84514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-fd346d73-4e81-4640-84c4-796be3200364 tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:26 devstack sudo[84514]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7" returned: 0 in 0.512s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:26 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:02:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-fd346d73-4e81-4640-84c4-796be3200364 tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.235s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:26 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-fd346d73-4e81-4640-84c4-796be3200364 tempest-VolumesDeleteCascade-1939462024 None] Creating offline snapshot 1588c750-e08f-4970-bca5-39d5cdee7fd2 of volume eaa9de33-7af1-4d4b-b97d-b13b84ec0aba {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:02:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc42162b-5030-4374-a581-3db5d4799fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6969635e-e7c1-435d-9056-8834d35b3df7', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c320bfc-b6e9-438f-b79f-d5e00826835d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:26 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[72628c7a-9f50-4550-b603-3dfe183b7b41]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fd346d73-4e81-4640-84c4-796be3200364 tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:26 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Volume volume-6969635e-e7c1-435d-9056-8834d35b3df7 (6969635e-e7c1-435d-9056-8834d35b3df7): created successfully Feb 27 02:02:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c320bfc-b6e9-438f-b79f-d5e00826835d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Flow 'volume_create_manager' (48a22974-18f1-4299-bcee-e062e8a35f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:26 devstack cinder-volume[82683]: INFO cinder.volume.manager [req-6f1ed1b7-a858-4a07-8cc6-961c2ea4c48c req-ac1349fb-364d-4513-839a-b2e09db6f673 tempest-VolumesSnapshotsTestJSON-913044066 None] Created volume successfully. Feb 27 02:02:26 devstack sudo[84517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba Feb 27 02:02:26 devstack sudo[84517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-3eee0097-2d83-40fe-b9fa-2cbdc2e86155 req-3123121a-4181-411f-b75d-edd385434bbb tempest-VolumesSnapshotsTestJSON-913044066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:27 devstack sudo[84517]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fd346d73-4e81-4640-84c4-796be3200364 tempest-VolumesDeleteCascade-1939462024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba" returned: 0 in 0.723s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fd346d73-4e81-4640-84c4-796be3200364 tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:27 devstack sudo[84522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 1G Feb 27 02:02:27 devstack sudo[84522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:28 devstack sudo[84522]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fd346d73-4e81-4640-84c4-796be3200364 tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 1G" returned: 0 in 0.628s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fd346d73-4e81-4640-84c4-796be3200364 tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:28 devstack sudo[84528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 Feb 27 02:02:28 devstack sudo[84528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:28 devstack sudo[84528]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fd346d73-4e81-4640-84c4-796be3200364 tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2" returned: 0 in 0.558s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:28 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-fd346d73-4e81-4640-84c4-796be3200364 tempest-VolumesDeleteCascade-1939462024 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 is being set with open permissions: ugo+rw Feb 27 02:02:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fd346d73-4e81-4640-84c4-796be3200364 tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:28 devstack sudo[84533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 Feb 27 02:02:28 devstack sudo[84533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:29 devstack sudo[84533]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fd346d73-4e81-4640-84c4-796be3200364 tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2" returned: 0 in 0.497s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fd346d73-4e81-4640-84c4-796be3200364 tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:29 devstack sudo[84539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.info Feb 27 02:02:29 devstack sudo[84539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:29 devstack sudo[84539]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fd346d73-4e81-4640-84c4-796be3200364 tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.info" returned: 0 in 0.492s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:29 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-fd346d73-4e81-4640-84c4-796be3200364 tempest-VolumesDeleteCascade-1939462024 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.info is being set with open permissions: ugo+rw Feb 27 02:02:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fd346d73-4e81-4640-84c4-796be3200364 tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:29 devstack sudo[84542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.info Feb 27 02:02:29 devstack sudo[84542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:30 devstack sudo[84542]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fd346d73-4e81-4640-84c4-796be3200364 tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.info" returned: 0 in 0.464s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-fd346d73-4e81-4640-84c4-796be3200364 tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.446s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-3eee0097-2d83-40fe-b9fa-2cbdc2e86155 req-3123121a-4181-411f-b75d-edd385434bbb tempest-VolumesSnapshotsTestJSON-913044066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.875s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:30 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [req-3eee0097-2d83-40fe-b9fa-2cbdc2e86155 req-3123121a-4181-411f-b75d-edd385434bbb tempest-VolumesSnapshotsTestJSON-913044066 None] Creating offline snapshot abc98a7e-4e7e-464d-896c-2e7ea363d202 of volume 6969635e-e7c1-435d-9056-8834d35b3df7 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:02:30 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-fd346d73-4e81-4640-84c4-796be3200364 tempest-VolumesDeleteCascade-1939462024 None] Create snapshot completed successfully Feb 27 02:02:30 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a336069-4961-430d-93bc-a7fa729b9a89]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-3eee0097-2d83-40fe-b9fa-2cbdc2e86155 req-3123121a-4181-411f-b75d-edd385434bbb tempest-VolumesSnapshotsTestJSON-913044066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:30 devstack sudo[84545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7 Feb 27 02:02:30 devstack sudo[84545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-82db38f9-b9b9-4be1-8997-7940bff72732 tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:30 devstack sudo[84545]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-3eee0097-2d83-40fe-b9fa-2cbdc2e86155 req-3123121a-4181-411f-b75d-edd385434bbb tempest-VolumesSnapshotsTestJSON-913044066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7" returned: 0 in 0.752s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-3eee0097-2d83-40fe-b9fa-2cbdc2e86155 req-3123121a-4181-411f-b75d-edd385434bbb tempest-VolumesSnapshotsTestJSON-913044066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.abc98a7e-4e7e-464d-896c-2e7ea363d202 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:30 devstack sudo[84575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.abc98a7e-4e7e-464d-896c-2e7ea363d202 1G Feb 27 02:02:30 devstack sudo[84575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:31 devstack sudo[84575]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-3eee0097-2d83-40fe-b9fa-2cbdc2e86155 req-3123121a-4181-411f-b75d-edd385434bbb tempest-VolumesSnapshotsTestJSON-913044066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.abc98a7e-4e7e-464d-896c-2e7ea363d202 1G" returned: 0 in 0.592s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-3eee0097-2d83-40fe-b9fa-2cbdc2e86155 req-3123121a-4181-411f-b75d-edd385434bbb tempest-VolumesSnapshotsTestJSON-913044066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6969635e-e7c1-435d-9056-8834d35b3df7 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.abc98a7e-4e7e-464d-896c-2e7ea363d202 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:31 devstack sudo[84580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6969635e-e7c1-435d-9056-8834d35b3df7 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.abc98a7e-4e7e-464d-896c-2e7ea363d202 Feb 27 02:02:31 devstack sudo[84580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:32 devstack sudo[84580]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-3eee0097-2d83-40fe-b9fa-2cbdc2e86155 req-3123121a-4181-411f-b75d-edd385434bbb tempest-VolumesSnapshotsTestJSON-913044066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6969635e-e7c1-435d-9056-8834d35b3df7 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.abc98a7e-4e7e-464d-896c-2e7ea363d202" returned: 0 in 0.503s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:32 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [req-3eee0097-2d83-40fe-b9fa-2cbdc2e86155 req-3123121a-4181-411f-b75d-edd385434bbb tempest-VolumesSnapshotsTestJSON-913044066 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.abc98a7e-4e7e-464d-896c-2e7ea363d202 is being set with open permissions: ugo+rw Feb 27 02:02:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-3eee0097-2d83-40fe-b9fa-2cbdc2e86155 req-3123121a-4181-411f-b75d-edd385434bbb tempest-VolumesSnapshotsTestJSON-913044066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.abc98a7e-4e7e-464d-896c-2e7ea363d202 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:32 devstack sudo[84588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.abc98a7e-4e7e-464d-896c-2e7ea363d202 Feb 27 02:02:32 devstack sudo[84588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:32 devstack sudo[84588]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-3eee0097-2d83-40fe-b9fa-2cbdc2e86155 req-3123121a-4181-411f-b75d-edd385434bbb tempest-VolumesSnapshotsTestJSON-913044066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.abc98a7e-4e7e-464d-896c-2e7ea363d202" returned: 0 in 0.482s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-3eee0097-2d83-40fe-b9fa-2cbdc2e86155 req-3123121a-4181-411f-b75d-edd385434bbb tempest-VolumesSnapshotsTestJSON-913044066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:32 devstack sudo[84591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.info Feb 27 02:02:32 devstack sudo[84591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:32 devstack sudo[84591]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-3eee0097-2d83-40fe-b9fa-2cbdc2e86155 req-3123121a-4181-411f-b75d-edd385434bbb tempest-VolumesSnapshotsTestJSON-913044066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.info" returned: 0 in 0.438s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:32 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [req-3eee0097-2d83-40fe-b9fa-2cbdc2e86155 req-3123121a-4181-411f-b75d-edd385434bbb tempest-VolumesSnapshotsTestJSON-913044066 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.info is being set with open permissions: ugo+rw Feb 27 02:02:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-3eee0097-2d83-40fe-b9fa-2cbdc2e86155 req-3123121a-4181-411f-b75d-edd385434bbb tempest-VolumesSnapshotsTestJSON-913044066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:33 devstack sudo[84594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.info Feb 27 02:02:33 devstack sudo[84594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:33 devstack sudo[84594]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-3eee0097-2d83-40fe-b9fa-2cbdc2e86155 req-3123121a-4181-411f-b75d-edd385434bbb tempest-VolumesSnapshotsTestJSON-913044066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.info" returned: 0 in 0.433s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-3eee0097-2d83-40fe-b9fa-2cbdc2e86155 req-3123121a-4181-411f-b75d-edd385434bbb tempest-VolumesSnapshotsTestJSON-913044066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.303s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-82db38f9-b9b9-4be1-8997-7940bff72732 tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.600s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:33 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-82db38f9-b9b9-4be1-8997-7940bff72732 tempest-VolumesDeleteCascade-1939462024 None] Creating offline snapshot 2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a of volume eaa9de33-7af1-4d4b-b97d-b13b84ec0aba {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:02:33 devstack cinder-volume[82683]: INFO cinder.volume.manager [req-3eee0097-2d83-40fe-b9fa-2cbdc2e86155 req-3123121a-4181-411f-b75d-edd385434bbb tempest-VolumesSnapshotsTestJSON-913044066 None] Create snapshot completed successfully Feb 27 02:02:33 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35d3a65-6ec8-40e3-b5ca-488d6d22d7c1]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-82db38f9-b9b9-4be1-8997-7940bff72732 tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:33 devstack sudo[84597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 Feb 27 02:02:33 devstack sudo[84597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] Acquiring lock "cinder-abc98a7e-4e7e-464d-896c-2e7ea363d202-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] Lock "cinder-abc98a7e-4e7e-464d-896c-2e7ea363d202-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] Acquiring lock "cinder-quobyte-6969635e-e7c1-435d-9056-8834d35b3df7" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] Lock "cinder-quobyte-6969635e-e7c1-435d-9056-8834d35b3df7" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] Acquiring lock "cinder-quobyte-abc98a7e-4e7e-464d-896c-2e7ea363d202" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] Lock "cinder-quobyte-abc98a7e-4e7e-464d-896c-2e7ea363d202" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:33 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] Deleting offline snapshot abc98a7e-4e7e-464d-896c-2e7ea363d202 of volume 6969635e-e7c1-435d-9056-8834d35b3df7 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:02:33 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] snapshot_file for this snap is: volume-6969635e-e7c1-435d-9056-8834d35b3df7.abc98a7e-4e7e-464d-896c-2e7ea363d202 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:02:33 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[710655c4-9537-44c9-99ea-27f12aae0c2b]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.abc98a7e-4e7e-464d-896c-2e7ea363d202 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:33 devstack sudo[84599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.abc98a7e-4e7e-464d-896c-2e7ea363d202 Feb 27 02:02:33 devstack sudo[84599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:34 devstack sudo[84597]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-82db38f9-b9b9-4be1-8997-7940bff72732 tempest-VolumesDeleteCascade-1939462024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2" returned: 0 in 0.620s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:34 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-82db38f9-b9b9-4be1-8997-7940bff72732 tempest-VolumesDeleteCascade-1939462024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:02:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-82db38f9-b9b9-4be1-8997-7940bff72732 tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:34 devstack sudo[84604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a 1G Feb 27 02:02:34 devstack sudo[84604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:34 devstack sudo[84599]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.abc98a7e-4e7e-464d-896c-2e7ea363d202" returned: 0 in 0.554s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:34 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6969635e-e7c1-435d-9056-8834d35b3df7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:02:34 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cfbfe7-e9c5-4e84-b57c-b6aaaf510de6]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:34 devstack sudo[84609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7 Feb 27 02:02:34 devstack sudo[84609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:34 devstack sudo[84604]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-82db38f9-b9b9-4be1-8997-7940bff72732 tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a 1G" returned: 0 in 0.564s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-82db38f9-b9b9-4be1-8997-7940bff72732 tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:34 devstack sudo[84614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a Feb 27 02:02:34 devstack sudo[84614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:34 devstack sudo[84609]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7" returned: 0 in 0.582s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.abc98a7e-4e7e-464d-896c-2e7ea363d202 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:35 devstack sudo[84619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.abc98a7e-4e7e-464d-896c-2e7ea363d202 Feb 27 02:02:35 devstack sudo[84619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:35 devstack sudo[84614]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-82db38f9-b9b9-4be1-8997-7940bff72732 tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a" returned: 0 in 0.464s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:35 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-82db38f9-b9b9-4be1-8997-7940bff72732 tempest-VolumesDeleteCascade-1939462024 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a is being set with open permissions: ugo+rw Feb 27 02:02:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-82db38f9-b9b9-4be1-8997-7940bff72732 tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:35 devstack sudo[84624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a Feb 27 02:02:35 devstack sudo[84624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:35 devstack sudo[84619]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.abc98a7e-4e7e-464d-896c-2e7ea363d202" returned: 0 in 0.607s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.abc98a7e-4e7e-464d-896c-2e7ea363d202 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:35 devstack sudo[84631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.abc98a7e-4e7e-464d-896c-2e7ea363d202 Feb 27 02:02:35 devstack sudo[84631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:35 devstack sudo[84624]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-82db38f9-b9b9-4be1-8997-7940bff72732 tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a" returned: 0 in 0.617s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-82db38f9-b9b9-4be1-8997-7940bff72732 tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.339s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:35 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-82db38f9-b9b9-4be1-8997-7940bff72732 tempest-VolumesDeleteCascade-1939462024 None] Create snapshot completed successfully Feb 27 02:02:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "cinder-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:36 devstack sudo[84631]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7.abc98a7e-4e7e-464d-896c-2e7ea363d202" returned: 0 in 0.550s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Performing cascade delete. {{(pid=82683) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 27 02:02:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] Lock "cinder-quobyte-abc98a7e-4e7e-464d-896c-2e7ea363d202" released by "_delete_snapshot" :: held 2.398s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "cinder-1588c750-e08f-4970-bca5-39d5cdee7fd2-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] Lock "cinder-quobyte-6969635e-e7c1-435d-9056-8834d35b3df7" released by "delete_snapshot" :: held 2.425s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-1588c750-e08f-4970-bca5-39d5cdee7fd2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "cinder-quobyte-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "cinder-quobyte-1588c750-e08f-4970-bca5-39d5cdee7fd2" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-1588c750-e08f-4970-bca5-39d5cdee7fd2" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:36 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Deleting offline snapshot 1588c750-e08f-4970-bca5-39d5cdee7fd2 of volume eaa9de33-7af1-4d4b-b97d-b13b84ec0aba {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:02:36 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] snapshot_file for this snap is: volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:02:36 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1665ba6-3f23-43ec-acd3-21f69b5d19db]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:36 devstack cinder-volume[82683]: DEBUG cinder.quota [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] Created reservations ['0bd7fc09-8939-4053-9f53-aafc7c05c707', '52830fc3-1034-44f6-b647-f3f93345e042', '74f086a1-edaa-450a-ac34-1aa3f641de7b', '4cf013e5-9f74-4f5b-967a-6c07f6f0e053'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:36 devstack cinder-volume[82683]: INFO cinder.volume.manager [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] Delete snapshot completed successfully. Feb 27 02:02:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-3f9cbc7f-b2a9-4449-bed2-623fac7d5c17 req-c2c55cde-0f56-473a-81bb-b36835d764b9 tempest-VolumesSnapshotsTestJSON-913044066 None] Lock "cinder-abc98a7e-4e7e-464d-896c-2e7ea363d202-delete_snapshot" released by "delete_snapshot" :: held 2.671s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:36 devstack sudo[84636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 Feb 27 02:02:36 devstack sudo[84636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:37 devstack sudo[84636]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2" returned: 0 in 0.676s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:37 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:02:37 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-143de45a-8207-4d3e-96f1-38b5d1c17af4 req-c2af274f-fbed-42e6-a982-353e53ae3882 tempest-VolumesSnapshotsTestJSON-913044066 None] Acquiring lock "cinder-6969635e-e7c1-435d-9056-8834d35b3df7-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:37 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6695e2b8-96d6-45ae-ad6f-52d1fdc7972f]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:37 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-143de45a-8207-4d3e-96f1-38b5d1c17af4 req-c2af274f-fbed-42e6-a982-353e53ae3882 tempest-VolumesSnapshotsTestJSON-913044066 None] Lock "cinder-6969635e-e7c1-435d-9056-8834d35b3df7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:37 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-143de45a-8207-4d3e-96f1-38b5d1c17af4 req-c2af274f-fbed-42e6-a982-353e53ae3882 tempest-VolumesSnapshotsTestJSON-913044066 None] Acquiring lock "cinder-quobyte-6969635e-e7c1-435d-9056-8834d35b3df7" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:37 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-143de45a-8207-4d3e-96f1-38b5d1c17af4 req-c2af274f-fbed-42e6-a982-353e53ae3882 tempest-VolumesSnapshotsTestJSON-913044066 None] Lock "cinder-quobyte-6969635e-e7c1-435d-9056-8834d35b3df7" acquired by "delete_volume" :: waited 0.019s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:37 devstack sudo[84642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba Feb 27 02:02:37 devstack sudo[84642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:37 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e009ab-2e57-4045-9dfd-61064d8254ba]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-143de45a-8207-4d3e-96f1-38b5d1c17af4 req-c2af274f-fbed-42e6-a982-353e53ae3882 tempest-VolumesSnapshotsTestJSON-913044066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:37 devstack sudo[84644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7 Feb 27 02:02:37 devstack sudo[84644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:37 devstack sudo[84642]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba" returned: 0 in 0.739s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:37 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f417c69b-9690-46d8-a1d3-6a2ca7476b3e]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:37 devstack sudo[84644]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-143de45a-8207-4d3e-96f1-38b5d1c17af4 req-c2af274f-fbed-42e6-a982-353e53ae3882 tempest-VolumesSnapshotsTestJSON-913044066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7" returned: 0 in 0.684s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-143de45a-8207-4d3e-96f1-38b5d1c17af4 req-c2af274f-fbed-42e6-a982-353e53ae3882 tempest-VolumesSnapshotsTestJSON-913044066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:37 devstack sudo[84654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7 Feb 27 02:02:37 devstack sudo[84654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:38 devstack sudo[84653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a Feb 27 02:02:38 devstack sudo[84653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:38 devstack sudo[84653]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a" returned: 0 in 0.766s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:02:38 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[975d76a7-069c-4ea6-b27b-edfb22868693]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:38 devstack sudo[84654]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-143de45a-8207-4d3e-96f1-38b5d1c17af4 req-c2af274f-fbed-42e6-a982-353e53ae3882 tempest-VolumesSnapshotsTestJSON-913044066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6969635e-e7c1-435d-9056-8834d35b3df7" returned: 0 in 0.777s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-143de45a-8207-4d3e-96f1-38b5d1c17af4 req-c2af274f-fbed-42e6-a982-353e53ae3882 tempest-VolumesSnapshotsTestJSON-913044066 None] Lock "cinder-quobyte-6969635e-e7c1-435d-9056-8834d35b3df7" released by "delete_volume" :: held 1.496s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:38 devstack sudo[84673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 Feb 27 02:02:38 devstack sudo[84673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:38 devstack cinder-volume[82683]: DEBUG cinder.quota [req-143de45a-8207-4d3e-96f1-38b5d1c17af4 req-c2af274f-fbed-42e6-a982-353e53ae3882 tempest-VolumesSnapshotsTestJSON-913044066 None] Created reservations ['78808cb5-0923-403c-9236-783a43f805a5', '2849792f-5e0a-4ed2-a083-d9e682d41007', '28401342-7d44-40b5-950b-b14233aceed5', '5bbed42a-b3b8-48ef-ac30-45afb85445d2'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-143de45a-8207-4d3e-96f1-38b5d1c17af4 req-c2af274f-fbed-42e6-a982-353e53ae3882 tempest-VolumesSnapshotsTestJSON-913044066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-143de45a-8207-4d3e-96f1-38b5d1c17af4 req-c2af274f-fbed-42e6-a982-353e53ae3882 tempest-VolumesSnapshotsTestJSON-913044066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-143de45a-8207-4d3e-96f1-38b5d1c17af4 req-c2af274f-fbed-42e6-a982-353e53ae3882 tempest-VolumesSnapshotsTestJSON-913044066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-143de45a-8207-4d3e-96f1-38b5d1c17af4 req-c2af274f-fbed-42e6-a982-353e53ae3882 tempest-VolumesSnapshotsTestJSON-913044066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-143de45a-8207-4d3e-96f1-38b5d1c17af4 req-c2af274f-fbed-42e6-a982-353e53ae3882 tempest-VolumesSnapshotsTestJSON-913044066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-143de45a-8207-4d3e-96f1-38b5d1c17af4 req-c2af274f-fbed-42e6-a982-353e53ae3882 tempest-VolumesSnapshotsTestJSON-913044066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:38 devstack sudo[84678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:02:38 devstack sudo[84678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:39 devstack sudo[84673]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2" returned: 0 in 0.610s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:39 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:02:39 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4460ad6-9c5b-4448-ba94-7e9e2ec9d867]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:39 devstack sudo[84686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba Feb 27 02:02:39 devstack sudo[84686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:39 devstack sudo[84678]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-143de45a-8207-4d3e-96f1-38b5d1c17af4 req-c2af274f-fbed-42e6-a982-353e53ae3882 tempest-VolumesSnapshotsTestJSON-913044066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.624s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:39 devstack cinder-volume[82683]: DEBUG cinder.manager [req-143de45a-8207-4d3e-96f1-38b5d1c17af4 req-c2af274f-fbed-42e6-a982-353e53ae3882 tempest-VolumesSnapshotsTestJSON-913044066 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:39 devstack cinder-volume[82683]: INFO cinder.volume.manager [req-143de45a-8207-4d3e-96f1-38b5d1c17af4 req-c2af274f-fbed-42e6-a982-353e53ae3882 tempest-VolumesSnapshotsTestJSON-913044066 None] Deleted volume successfully. Feb 27 02:02:39 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-143de45a-8207-4d3e-96f1-38b5d1c17af4 req-c2af274f-fbed-42e6-a982-353e53ae3882 tempest-VolumesSnapshotsTestJSON-913044066 None] Lock "cinder-6969635e-e7c1-435d-9056-8834d35b3df7-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:39 devstack sudo[84686]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba" returned: 0 in 0.696s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:39 devstack sudo[84692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 Feb 27 02:02:39 devstack sudo[84692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2" returned: 0 in 0.535s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:40 devstack sudo[84692]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:40 devstack sudo[84697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2 Feb 27 02:02:40 devstack sudo[84697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:41 devstack sudo[84697]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.1588c750-e08f-4970-bca5-39d5cdee7fd2" returned: 0 in 0.546s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a -F qcow2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:41 devstack sudo[84703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a -F qcow2 Feb 27 02:02:41 devstack sudo[84703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:41 devstack sudo[84703]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a -F qcow2" returned: 0 in 0.592s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-1588c750-e08f-4970-bca5-39d5cdee7fd2" released by "_delete_snapshot" :: held 5.325s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba" released by "delete_snapshot" :: held 5.377s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:41 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Created reservations ['d6c70ee3-739c-4761-8edf-fa006180d297', '4c657c07-45c7-4f0e-b308-b9c006fd0d5c', '220e79b6-fa60-4545-ae88-36dbc01dcb84', '339b19ce-7cdd-407e-ac09-f577f9e0b97a'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:41 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Delete snapshot completed successfully. Feb 27 02:02:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-1588c750-e08f-4970-bca5-39d5cdee7fd2-delete_snapshot" released by "delete_snapshot" :: held 5.529s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "cinder-2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "cinder-quobyte-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "cinder-quobyte-2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:41 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Deleting offline snapshot 2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a of volume eaa9de33-7af1-4d4b-b97d-b13b84ec0aba {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:02:41 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] snapshot_file for this snap is: volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:02:41 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35d272d-2445-469b-8d52-f999f53e017f]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:41 devstack sudo[84708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a Feb 27 02:02:41 devstack sudo[84708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:42 devstack sudo[84708]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a" returned: 0 in 0.594s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:42 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:02:42 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40c13ac-d018-42fc-a056-6c8d75f597fa]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:42 devstack sudo[84731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba Feb 27 02:02:42 devstack sudo[84731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2ef9ff5a-b66a-4523-9c9c-a8535d3cc253 tempest-BackendsCapabilitiesAdminTestsJSON-1266102898 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82683) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 27 02:02:43 devstack sudo[84731]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba" returned: 0 in 1.042s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:43 devstack sudo[84769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a Feb 27 02:02:43 devstack sudo[84769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-efd2c015-a226-43bb-9b9b-060a6dba9f22 tempest-BackendsCapabilitiesAdminTestsJSON-1266102898 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82683) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 27 02:02:44 devstack sudo[84769]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a" returned: 0 in 0.643s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:44 devstack sudo[84774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a Feb 27 02:02:44 devstack sudo[84774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:44 devstack sudo[84774]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba.2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a" returned: 0 in 0.541s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:44 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a" released by "_delete_snapshot" :: held 2.913s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:44 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba" released by "delete_snapshot" :: held 2.936s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:44 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Created reservations ['86684f87-f625-4497-b4bd-4fa0b4ce5dcf', '574942b1-f320-420b-adea-ea3835bb7367', '138fcae2-faa7-4e11-94f8-e129d900aed3', '70f83572-938a-492c-a7ac-8f946cc90bd3'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:44 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Delete snapshot completed successfully. Feb 27 02:02:44 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-2031bfc5-9b76-4d0c-8a65-6f936f1b2c9a-delete_snapshot" released by "delete_snapshot" :: held 3.211s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Snapshots deleted, issuing volume delete {{(pid=82683) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 27 02:02:44 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "cinder-quobyte-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:45 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:45 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[346e59e4-55a5-46c6-922d-b443bac7ed8a]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:45 devstack sudo[84778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba Feb 27 02:02:45 devstack sudo[84778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:46 devstack sudo[84778]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba" returned: 0 in 1.102s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:46 devstack sudo[84786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba Feb 27 02:02:46 devstack sudo[84786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:46 devstack sudo[84786]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba" returned: 0 in 0.774s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba" released by "delete_volume" :: held 1.991s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:47 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Created reservations ['e6667205-b227-4c57-b4c4-3b29e5199264', 'b15cb04a-1f87-47db-afbd-eb0d3c56f075', 'c2cfa481-682d-48ae-9992-22385b2befb7', 'ae088f3d-742a-4705-9eff-dd3f55692efa'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:02:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:47 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:47 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:47 devstack sudo[84789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:02:47 devstack sudo[84789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:47 devstack sudo[84789]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.759s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:47 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:02:47 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Deleted volume successfully. Feb 27 02:02:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acdfed82-18df-47bb-80a4-ee6ac20fff3e tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-eaa9de33-7af1-4d4b-b97d-b13b84ec0aba-delete_volume" released by "delete_volume" :: held 11.803s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Flow 'volume_create_manager' (d90fe8bf-a0eb-4f8f-9184-a91b8095f6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d699c36-a8ee-47d5-857c-be289e2fb836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d699c36-a8ee-47d5-857c-be289e2fb836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1476422464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fcd31e9-8ab2-4606-98a7-5aff84f90554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6998ea3a7fb74e608396d9b263e5b994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:48Z,use_quota=True,user_id='72dbcfd70e744ae3959e501a93f08bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (980a58ed-90a5-4890-aa6f-0a1dbc23064d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (980a58ed-90a5-4890-aa6f-0a1dbc23064d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211e7b93-87f3-43a7-a751-fd70c51513cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211e7b93-87f3-43a7-a751-fd70c51513cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fcd31e9-8ab2-4606-98a7-5aff84f90554', 'volume_name': 'volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27333584-1893-4778-a3e5-2abccc74ea92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27333584-1893-4778-a3e5-2abccc74ea92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094ce16b-23f5-4f05-8c1f-0dadff158c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:48 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Volume 4fcd31e9-8ab2-4606-98a7-5aff84f90554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554', 'volume_size': 1} Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1476422464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fcd31e9-8ab2-4606-98a7-5aff84f90554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6998ea3a7fb74e608396d9b263e5b994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:48Z,use_quota=True,user_id='72dbcfd70e744ae3959e501a93f08bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Creating volume 4fcd31e9-8ab2-4606-98a7-5aff84f90554 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:02:48 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:02:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:48 devstack sudo[84793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 1073741824 Feb 27 02:02:48 devstack sudo[84793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:49 devstack sudo[84793]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 1073741824" returned: 0 in 0.975s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:49 devstack sudo[84801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 Feb 27 02:02:49 devstack sudo[84801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:50 devstack sudo[84801]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554" returned: 0 in 0.695s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:50 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:02:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:50 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-ca8061eb-5c6e-4f44-b455-8231529704a2 tempest-GroupSnapshotsTest-487592209 None] Group tempest-GroupSnapshotsTest-Group-2051975136: creating Feb 27 02:02:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094ce16b-23f5-4f05-8c1f-0dadff158c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752ee8ce-c836-4335-91ee-723aeda974c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:50 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Volume volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 (4fcd31e9-8ab2-4606-98a7-5aff84f90554): created successfully Feb 27 02:02:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752ee8ce-c836-4335-91ee-723aeda974c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Flow 'volume_create_manager' (d90fe8bf-a0eb-4f8f-9184-a91b8095f6fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:50 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-ca8061eb-5c6e-4f44-b455-8231529704a2 tempest-GroupSnapshotsTest-487592209 None] Group tempest-GroupSnapshotsTest-Group-2051975136: created successfully Feb 27 02:02:50 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-0514516b-972a-481d-8bbe-14da2f0a2e27 tempest-VolumesDeleteCascade-1939462024 None] Created volume successfully. Feb 27 02:02:50 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-ca8061eb-5c6e-4f44-b455-8231529704a2 tempest-GroupSnapshotsTest-487592209 None] Create group completed successfully. Feb 27 02:02:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4e9e130e-73ab-4f39-979a-23e18968763e tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4e9e130e-73ab-4f39-979a-23e18968763e tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:50 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-4e9e130e-73ab-4f39-979a-23e18968763e tempest-VolumesDeleteCascade-1939462024 None] Creating offline snapshot a94498e8-a6c9-4bcb-addb-e6311ca6bd87 of volume 4fcd31e9-8ab2-4606-98a7-5aff84f90554 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:02:50 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[639ffb1d-eff5-4691-8c5d-46acadc82121]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e9e130e-73ab-4f39-979a-23e18968763e tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:50 devstack sudo[84804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 Feb 27 02:02:50 devstack sudo[84804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:51 devstack sudo[84804]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e9e130e-73ab-4f39-979a-23e18968763e tempest-VolumesDeleteCascade-1939462024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554" returned: 0 in 0.678s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e9e130e-73ab-4f39-979a-23e18968763e tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:51 devstack sudo[84809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87 1G Feb 27 02:02:51 devstack sudo[84809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:52 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:02:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Flow 'volume_create_manager' (0e0d21b4-2d8b-4774-a8f2-f6638efdb25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f04555d-fe43-4b68-8c14-bed7f22552b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f04555d-fe43-4b68-8c14-bed7f22552b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-839104714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84790792-8218-49e4-b355-dbc19840e58c,host='devstack@QuobyteHD#QuobyteHD',id=8192b62a-bbae-4922-8300-8ab7d7943601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56d45f666c694f60955bdf68e51b9af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:52Z,use_quota=True,user_id='11c4672cca1b480a9438ee0fb1550fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bd7d8d7-7203-4f18-8aac-f7a1d113f6f4),volume_type_id=8bd7d8d7-7203-4f18-8aac-f7a1d113f6f4)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926e2eec-bcdc-4f17-a8c1-081ea57430cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (926e2eec-bcdc-4f17-a8c1-081ea57430cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ef240d-a998-486a-8b0c-c80f7683069e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ef240d-a998-486a-8b0c-c80f7683069e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8192b62a-bbae-4922-8300-8ab7d7943601', 'volume_name': 'volume-8192b62a-bbae-4922-8300-8ab7d7943601', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61413f1-c402-474d-8dcf-1a0a089ea557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61413f1-c402-474d-8dcf-1a0a089ea557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130f543d-db33-4818-b175-14f197819081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:52 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Volume 8192b62a-bbae-4922-8300-8ab7d7943601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8192b62a-bbae-4922-8300-8ab7d7943601', 'volume_size': 1} Feb 27 02:02:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:52 devstack sudo[84809]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e9e130e-73ab-4f39-979a-23e18968763e tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87 1G" returned: 0 in 1.620s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e9e130e-73ab-4f39-979a-23e18968763e tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:52 devstack sudo[84827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87 Feb 27 02:02:52 devstack sudo[84827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:53 devstack sudo[84827]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e9e130e-73ab-4f39-979a-23e18968763e tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87" returned: 0 in 1.036s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:53 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-4e9e130e-73ab-4f39-979a-23e18968763e tempest-VolumesDeleteCascade-1939462024 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87 is being set with open permissions: ugo+rw Feb 27 02:02:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e9e130e-73ab-4f39-979a-23e18968763e tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:53 devstack sudo[84835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87 Feb 27 02:02:53 devstack sudo[84835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:54 devstack sudo[84835]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e9e130e-73ab-4f39-979a-23e18968763e tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87" returned: 0 in 0.706s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e9e130e-73ab-4f39-979a-23e18968763e tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:54 devstack sudo[84839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.info Feb 27 02:02:54 devstack sudo[84839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:55 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:02:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Flow 'volume_create_manager' (5306cea1-d910-4f65-b8f7-12311b544846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe46a34-f3d9-40f4-b049-e66b160438a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe46a34-f3d9-40f4-b049-e66b160438a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:55Z,deleted=False,deleted_at=None,display_description='',display_name='c18c5278-2e5c-4473-8019-b7e90b1b0cad-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38ec5673-41d0-41b6-94af-b6c1a514675b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24236992899465fa8ea61c589ab3708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:56Z,use_quota=True,user_id='06dca7fac38749348b7c60ab187bed56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f948b49-56cb-4d15-9759-5ad32532f3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f948b49-56cb-4d15-9759-5ad32532f3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff3e2a5-d98c-4b8d-82c5-e854209ea485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff3e2a5-d98c-4b8d-82c5-e854209ea485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38ec5673-41d0-41b6-94af-b6c1a514675b', 'volume_name': 'volume-38ec5673-41d0-41b6-94af-b6c1a514675b', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f42937da-7a13-4c7e-b3f9-1d5aa029e6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f42937da-7a13-4c7e-b3f9-1d5aa029e6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509f19ed-e9bf-4d10-989f-5cb4b1a3b369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:55 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Volume 38ec5673-41d0-41b6-94af-b6c1a514675b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38ec5673-41d0-41b6-94af-b6c1a514675b', 'volume_size': 1} Feb 27 02:02:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:55 devstack sudo[84839]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e9e130e-73ab-4f39-979a-23e18968763e tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.info" returned: 0 in 1.115s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:55 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-4e9e130e-73ab-4f39-979a-23e18968763e tempest-VolumesDeleteCascade-1939462024 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.info is being set with open permissions: ugo+rw Feb 27 02:02:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e9e130e-73ab-4f39-979a-23e18968763e tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:55 devstack sudo[84842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.info Feb 27 02:02:55 devstack sudo[84842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:56 devstack sudo[84842]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e9e130e-73ab-4f39-979a-23e18968763e tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.info" returned: 0 in 0.656s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4e9e130e-73ab-4f39-979a-23e18968763e tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.981s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.183s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=84790792-8218-49e4-b355-dbc19840e58c,created_at=2026-02-27T01:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-839104714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84790792-8218-49e4-b355-dbc19840e58c,host='devstack@QuobyteHD#QuobyteHD',id=8192b62a-bbae-4922-8300-8ab7d7943601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56d45f666c694f60955bdf68e51b9af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:52Z,use_quota=True,user_id='11c4672cca1b480a9438ee0fb1550fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bd7d8d7-7203-4f18-8aac-f7a1d113f6f4),volume_type_id=8bd7d8d7-7203-4f18-8aac-f7a1d113f6f4)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:02:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Creating volume 8192b62a-bbae-4922-8300-8ab7d7943601 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:02:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:02:56 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:02:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:56 devstack sudo[84846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601 1073741824 Feb 27 02:02:56 devstack sudo[84846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:56 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-4e9e130e-73ab-4f39-979a-23e18968763e tempest-VolumesDeleteCascade-1939462024 None] Create snapshot completed successfully Feb 27 02:02:57 devstack sudo[84846]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601 1073741824" returned: 0 in 0.644s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:57 devstack sudo[84854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601 Feb 27 02:02:57 devstack sudo[84854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Flow 'volume_create_manager' (202d8315-3f3d-4917-98d1-8540def36936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be8dfaa-0704-4cc0-b7c8-5d4acf27547d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be8dfaa-0704-4cc0-b7c8-5d4acf27547d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-717527635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89432e53-4b2b-4f80-91ea-bc590e76bb05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6998ea3a7fb74e608396d9b263e5b994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a94498e8-a6c9-4bcb-addb-e6311ca6bd87,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:57Z,use_quota=True,user_id='72dbcfd70e744ae3959e501a93f08bdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c65d2a-dc7b-485b-8f9c-2047ea5fd1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c65d2a-dc7b-485b-8f9c-2047ea5fd1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1d62fb-ab30-45a7-9608-8b4e516011b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1d62fb-ab30-45a7-9608-8b4e516011b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '89432e53-4b2b-4f80-91ea-bc590e76bb05', 'volume_name': 'volume-89432e53-4b2b-4f80-91ea-bc590e76bb05', 'volume_size': 1, 'snapshot_id': 'a94498e8-a6c9-4bcb-addb-e6311ca6bd87'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c106996-ba00-4284-be8a-1b3dee5c76ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c106996-ba00-4284-be8a-1b3dee5c76ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c85883-51f3-450f-a527-dab474cbcc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:57 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Volume 89432e53-4b2b-4f80-91ea-bc590e76bb05: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-89432e53-4b2b-4f80-91ea-bc590e76bb05', 'volume_size': 1, 'snapshot_id': 'a94498e8-a6c9-4bcb-addb-e6311ca6bd87'} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:57 devstack sudo[84854]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601" returned: 0 in 0.505s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.931s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:02:55Z,deleted=False,deleted_at=None,display_description='',display_name='c18c5278-2e5c-4473-8019-b7e90b1b0cad-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38ec5673-41d0-41b6-94af-b6c1a514675b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24236992899465fa8ea61c589ab3708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:02:56Z,use_quota=True,user_id='06dca7fac38749348b7c60ab187bed56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Creating volume 38ec5673-41d0-41b6-94af-b6c1a514675b {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:02:57 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38ec5673-41d0-41b6-94af-b6c1a514675b 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130f543d-db33-4818-b175-14f197819081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8192b62a-bbae-4922-8300-8ab7d7943601', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:57 devstack sudo[84857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38ec5673-41d0-41b6-94af-b6c1a514675b 1073741824 Feb 27 02:02:57 devstack sudo[84857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937abe9f-f2f1-4665-b6ba-59ac1e544b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:57 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Volume volume-8192b62a-bbae-4922-8300-8ab7d7943601 (8192b62a-bbae-4922-8300-8ab7d7943601): created successfully Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (937abe9f-f2f1-4665-b6ba-59ac1e544b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Flow 'volume_create_manager' (0e0d21b4-2d8b-4774-a8f2-f6638efdb25a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:57 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-798163b5-057e-4fbf-bc30-fda200f41755 tempest-GroupSnapshotsTest-487592209 None] Created volume successfully. Feb 27 02:02:58 devstack sudo[84857]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38ec5673-41d0-41b6-94af-b6c1a514675b 1073741824" returned: 0 in 0.788s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38ec5673-41d0-41b6-94af-b6c1a514675b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:58 devstack sudo[84888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38ec5673-41d0-41b6-94af-b6c1a514675b Feb 27 02:02:58 devstack sudo[84888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:02:59 devstack sudo[84888]: pam_unix(sudo:session): session closed for user root Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38ec5673-41d0-41b6-94af-b6c1a514675b" returned: 0 in 0.611s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.835s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "cinder-quobyte-a94498e8-a6c9-4bcb-addb-e6311ca6bd87-89432e53-4b2b-4f80-91ea-bc590e76bb05" by "_create_volume_from_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509f19ed-e9bf-4d10-989f-5cb4b1a3b369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38ec5673-41d0-41b6-94af-b6c1a514675b', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf509ba1-f908-44d9-851b-853dfe927aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-a94498e8-a6c9-4bcb-addb-e6311ca6bd87-89432e53-4b2b-4f80-91ea-bc590e76bb05" acquired by "_create_volume_from_snapshot" :: waited 0.069s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Creating volume 89432e53-4b2b-4f80-91ea-bc590e76bb05 from snapshot a94498e8-a6c9-4bcb-addb-e6311ca6bd87 {{(pid=82683) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "cinder-quobyte-89432e53-4b2b-4f80-91ea-bc590e76bb05" by "_copy_volume_from_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:02:59 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-2cf5e240-cc5a-4a1e-9561-3be1e09e369f tempest-GroupSnapshotsTest-487592209 None] GroupSnapshot c08d53d7-2585-4df6-aa7b-d25e328394e5: creating. Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-89432e53-4b2b-4f80-91ea-bc590e76bb05" acquired by "_copy_volume_from_snapshot" :: waited 0.085s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] snapshot: a94498e8-a6c9-4bcb-addb-e6311ca6bd87, volume: 89432e53-4b2b-4f80-91ea-bc590e76bb05, {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:02:59 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Volume volume-38ec5673-41d0-41b6-94af-b6c1a514675b (38ec5673-41d0-41b6-94af-b6c1a514675b): created successfully Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf509ba1-f908-44d9-851b-853dfe927aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Flow 'volume_create_manager' (5306cea1-d910-4f65-b8f7-12311b544846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2cf5e240-cc5a-4a1e-9561-3be1e09e369f tempest-GroupSnapshotsTest-487592209 None] Group snapshot c08d53d7-2585-4df6-aa7b-d25e328394e5: creating. {{(pid=82683) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 02:02:59 devstack cinder-volume[82683]: INFO cinder.volume.manager [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-45d611bd-69cb-40b1-af3a-cacadc2f8d67 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Created volume successfully. Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2cf5e240-cc5a-4a1e-9561-3be1e09e369f tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ebc67c-36fd-492c-a500-3efc50b9ef0c]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:02:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:02:59 devstack sudo[84897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87 Feb 27 02:02:59 devstack sudo[84897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:00 devstack sudo[84897]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87" returned: 0 in 0.598s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] will copy from snapshot at /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:03:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Creating direct copy from snapshot {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:03:00 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[90637583-43db-4897-bea2-a7e3d398547b]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:00 devstack sudo[84903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 Feb 27 02:03:00 devstack sudo[84903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:00 devstack sudo[84903]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554" returned: 0 in 0.657s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:00 devstack cinder-volume[82683]: DEBUG cinder.utils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Path /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-89432e53-4b2b-4f80-91ea-bc590e76bb05 not found in is_blk_device check {{(pid=82683) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:03:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-89432e53-4b2b-4f80-91ea-bc590e76bb05 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:00 devstack sudo[84908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-89432e53-4b2b-4f80-91ea-bc590e76bb05 Feb 27 02:03:00 devstack sudo[84908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-d0665354-c519-4abf-af51-34f59a413c5b tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:05 devstack sudo[84908]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-89432e53-4b2b-4f80-91ea-bc590e76bb05" returned: 0 in 4.709s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:05 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5ecf33-f5d7-4f91-b560-3716a487051a]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:05 devstack sudo[85030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 Feb 27 02:03:05 devstack sudo[85030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:06 devstack sudo[85030]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554" returned: 0 in 0.616s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:06 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Image conversion details: src /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554, size 1024.00 MB, duration 4.71 sec, destination /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-89432e53-4b2b-4f80-91ea-bc590e76bb05 {{(pid=82683) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:03:06 devstack cinder-volume[82683]: INFO cinder.image.image_utils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Converted 1024.00 MB image at 217.40 MB/s Feb 27 02:03:06 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-89432e53-4b2b-4f80-91ea-bc590e76bb05 is being set with open permissions: ugo+rw Feb 27 02:03:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-89432e53-4b2b-4f80-91ea-bc590e76bb05 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:06 devstack sudo[85035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-89432e53-4b2b-4f80-91ea-bc590e76bb05 Feb 27 02:03:06 devstack sudo[85035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:06 devstack sudo[85035]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-89432e53-4b2b-4f80-91ea-bc590e76bb05" returned: 0 in 0.586s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-89432e53-4b2b-4f80-91ea-bc590e76bb05" released by "_copy_volume_from_snapshot" :: held 7.374s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-a94498e8-a6c9-4bcb-addb-e6311ca6bd87-89432e53-4b2b-4f80-91ea-bc590e76bb05" released by "_create_volume_from_snapshot" :: held 7.520s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.591s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2cf5e240-cc5a-4a1e-9561-3be1e09e369f tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.248s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:06 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-2cf5e240-cc5a-4a1e-9561-3be1e09e369f tempest-GroupSnapshotsTest-487592209 None] Creating offline snapshot 3545e3c0-c2dd-4663-bd69-05217e3cb6f4 of volume 8192b62a-bbae-4922-8300-8ab7d7943601 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:03:06 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7669b7d2-e567-495f-92ab-75e2f7e54001]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2cf5e240-cc5a-4a1e-9561-3be1e09e369f tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c85883-51f3-450f-a527-dab474cbcc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89432e53-4b2b-4f80-91ea-bc590e76bb05', 'volume_size': 1, 'snapshot_id': 'a94498e8-a6c9-4bcb-addb-e6311ca6bd87'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e0d602-f7b0-4c8c-9082-77e7884c1fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:06 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Volume volume-89432e53-4b2b-4f80-91ea-bc590e76bb05 (89432e53-4b2b-4f80-91ea-bc590e76bb05): created successfully Feb 27 02:03:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e0d602-f7b0-4c8c-9082-77e7884c1fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Flow 'volume_create_manager' (202d8315-3f3d-4917-98d1-8540def36936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:06 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-401c4d60-81a0-4c1e-8613-0270bd7b77a1 tempest-VolumesDeleteCascade-1939462024 None] Created volume successfully. Feb 27 02:03:06 devstack sudo[85038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601 Feb 27 02:03:06 devstack sudo[85038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:07 devstack sudo[85038]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2cf5e240-cc5a-4a1e-9561-3be1e09e369f tempest-GroupSnapshotsTest-487592209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601" returned: 0 in 0.483s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2cf5e240-cc5a-4a1e-9561-3be1e09e369f tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:07 devstack sudo[85043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4 1G Feb 27 02:03:07 devstack sudo[85043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "cinder-4fcd31e9-8ab2-4606-98a7-5aff84f90554-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-4fcd31e9-8ab2-4606-98a7-5aff84f90554-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:07 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Performing cascade delete. {{(pid=82683) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 27 02:03:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "cinder-a94498e8-a6c9-4bcb-addb-e6311ca6bd87-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-a94498e8-a6c9-4bcb-addb-e6311ca6bd87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "cinder-quobyte-4fcd31e9-8ab2-4606-98a7-5aff84f90554" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-4fcd31e9-8ab2-4606-98a7-5aff84f90554" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "cinder-quobyte-a94498e8-a6c9-4bcb-addb-e6311ca6bd87" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-a94498e8-a6c9-4bcb-addb-e6311ca6bd87" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:07 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Deleting offline snapshot a94498e8-a6c9-4bcb-addb-e6311ca6bd87 of volume 4fcd31e9-8ab2-4606-98a7-5aff84f90554 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:03:07 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] snapshot_file for this snap is: volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:03:07 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0839b154-81a0-49bb-871d-b4d106ca64d3]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:07 devstack sudo[85045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87 Feb 27 02:03:07 devstack sudo[85045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:08 devstack sudo[85043]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2cf5e240-cc5a-4a1e-9561-3be1e09e369f tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4 1G" returned: 0 in 0.765s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2cf5e240-cc5a-4a1e-9561-3be1e09e369f tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8192b62a-bbae-4922-8300-8ab7d7943601 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:08 devstack sudo[85058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8192b62a-bbae-4922-8300-8ab7d7943601 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4 Feb 27 02:03:08 devstack sudo[85058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:08 devstack sudo[85045]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87" returned: 0 in 0.752s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:08 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:08 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76cf053-011f-438c-b058-1672aa3c724b]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:08 devstack sudo[85065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 Feb 27 02:03:08 devstack sudo[85065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:08 devstack sudo[85058]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2cf5e240-cc5a-4a1e-9561-3be1e09e369f tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8192b62a-bbae-4922-8300-8ab7d7943601 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4" returned: 0 in 0.516s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:08 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-2cf5e240-cc5a-4a1e-9561-3be1e09e369f tempest-GroupSnapshotsTest-487592209 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:03:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2cf5e240-cc5a-4a1e-9561-3be1e09e369f tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:08 devstack sudo[85068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4 Feb 27 02:03:08 devstack sudo[85068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:09 devstack sudo[85065]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554" returned: 0 in 0.750s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:09 devstack sudo[85073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87 Feb 27 02:03:09 devstack sudo[85073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:09 devstack cinder-volume[82683]: DEBUG oslo_service.periodic_task [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:03:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:09 devstack sudo[85076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:03:09 devstack sudo[85076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:09 devstack sudo[85068]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2cf5e240-cc5a-4a1e-9561-3be1e09e369f tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4" returned: 0 in 0.870s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:09 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:UPDATE=89,cinder:SELECT=89,cinder:INSERT=20,cinder:DELETE=6 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:03:09 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:SELECT=68,cinder:UPDATE=72,cinder:DELETE=9,cinder:INSERT=21 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:03:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2cf5e240-cc5a-4a1e-9561-3be1e09e369f tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:09 devstack sudo[85079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.info Feb 27 02:03:09 devstack sudo[85079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:09 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:09 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Flow 'volume_create_manager' (8a4b0812-21b6-41c8-a327-fcda42486f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:09 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5ad42a-90c3-44c3-b2a0-f4074bea3a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5ad42a-90c3-44c3-b2a0-f4074bea3a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-380507775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa50481b-a887-41b1-ae6f-0fd6b30eb521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30bf490d6fb4cdfb54ed49346f30826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:10Z,use_quota=True,user_id='e35ded19fb0441e593907157315539aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64109da7-eb15-4727-b1f9-253c54ff965b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64109da7-eb15-4727-b1f9-253c54ff965b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:10 devstack sudo[85076]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c6ecfa-f64f-4d88-912c-c72548040fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c6ecfa-f64f-4d88-912c-c72548040fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa50481b-a887-41b1-ae6f-0fd6b30eb521', 'volume_name': 'volume-fa50481b-a887-41b1-ae6f-0fd6b30eb521', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97a0660-bedd-4dfa-82ca-ea35f1571b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97a0660-bedd-4dfa-82ca-ea35f1571b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fa2d11-6f6f-4f5a-a0ee-79d2125119af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:10 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Volume fa50481b-a887-41b1-ae6f-0fd6b30eb521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa50481b-a887-41b1-ae6f-0fd6b30eb521', 'volume_size': 1} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.670s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:10 devstack sudo[85073]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87" returned: 0 in 0.905s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:10 devstack sudo[85085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87 Feb 27 02:03:10 devstack sudo[85085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:10 devstack sudo[85079]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2cf5e240-cc5a-4a1e-9561-3be1e09e369f tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.info" returned: 0 in 0.710s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:10 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-2cf5e240-cc5a-4a1e-9561-3be1e09e369f tempest-GroupSnapshotsTest-487592209 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2cf5e240-cc5a-4a1e-9561-3be1e09e369f tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:10 devstack sudo[85088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.info Feb 27 02:03:10 devstack sudo[85088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:10 devstack sudo[85085]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554.a94498e8-a6c9-4bcb-addb-e6311ca6bd87" returned: 0 in 0.434s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-a94498e8-a6c9-4bcb-addb-e6311ca6bd87" released by "_delete_snapshot" :: held 2.942s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-4fcd31e9-8ab2-4606-98a7-5aff84f90554" released by "delete_snapshot" :: held 2.974s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Created reservations ['0de9833a-d88d-40f4-861b-6cd542a98f37', '24529fc0-9b9d-4689-bfa2-2972c4c46b2e', '84424402-39e0-4891-ba06-006d694fd446', 'add74ffd-f9ca-41b2-a53f-880b5398a3e0'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:10 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Delete snapshot completed successfully. Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-a94498e8-a6c9-4bcb-addb-e6311ca6bd87-delete_snapshot" released by "delete_snapshot" :: held 3.127s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Snapshots deleted, issuing volume delete {{(pid=82683) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "cinder-quobyte-4fcd31e9-8ab2-4606-98a7-5aff84f90554" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-4fcd31e9-8ab2-4606-98a7-5aff84f90554" acquired by "delete_volume" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebff980-086c-40ef-8cd8-197ae25140db]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:10 devstack sudo[85088]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2cf5e240-cc5a-4a1e-9561-3be1e09e369f tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.info" returned: 0 in 0.562s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2cf5e240-cc5a-4a1e-9561-3be1e09e369f tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.082s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-d0665354-c519-4abf-af51-34f59a413c5b tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.957s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:10 devstack sudo[85093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 Feb 27 02:03:10 devstack sudo[85093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[14acd697-3a33-4648-ba70-58b68feb9033]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-d0665354-c519-4abf-af51-34f59a413c5b tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38ec5673-41d0-41b6-94af-b6c1a514675b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:10 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-2cf5e240-cc5a-4a1e-9561-3be1e09e369f tempest-GroupSnapshotsTest-487592209 None] group_snapshot c08d53d7-2585-4df6-aa7b-d25e328394e5: created successfully Feb 27 02:03:11 devstack sudo[85095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38ec5673-41d0-41b6-94af-b6c1a514675b Feb 27 02:03:11 devstack sudo[85095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:11 devstack sudo[85093]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554" returned: 0 in 0.716s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:11 devstack sudo[85103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554 Feb 27 02:03:11 devstack sudo[85103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:11 devstack sudo[85095]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-d0665354-c519-4abf-af51-34f59a413c5b tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38ec5673-41d0-41b6-94af-b6c1a514675b" returned: 0 in 0.657s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-d0665354-c519-4abf-af51-34f59a413c5b tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.690s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.547s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-380507775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa50481b-a887-41b1-ae6f-0fd6b30eb521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30bf490d6fb4cdfb54ed49346f30826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:10Z,use_quota=True,user_id='e35ded19fb0441e593907157315539aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Creating volume fa50481b-a887-41b1-ae6f-0fd6b30eb521 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:11 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:03:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-fa50481b-a887-41b1-ae6f-0fd6b30eb521 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:11 devstack sudo[85105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-fa50481b-a887-41b1-ae6f-0fd6b30eb521 1073741824 Feb 27 02:03:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-d0665354-c519-4abf-af51-34f59a413c5b tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3', 'name': 'volume-38ec5673-41d0-41b6-94af-b6c1a514675b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b87cc7b4-d308-4afb-bf2f-6182627e4f7f', 'enforce_multipath': True} {{(pid=82683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 27 02:03:11 devstack sudo[85105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:11 devstack cinder-volume[82683]: INFO cinder.volume.manager [req-60a52557-41ed-49aa-a9f5-53f55ffdec13 req-d0665354-c519-4abf-af51-34f59a413c5b tempest-ServerBootFromVolumeStableRescueTest-62742235 None] attachment_update completed successfully. Feb 27 02:03:12 devstack sudo[85103]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4fcd31e9-8ab2-4606-98a7-5aff84f90554" returned: 0 in 0.508s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-4fcd31e9-8ab2-4606-98a7-5aff84f90554" released by "delete_volume" :: held 1.297s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:12 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Created reservations ['0233d6fc-caf4-406c-9a05-6647a20172cb', 'aadcc267-1161-4c8d-bc53-fdad19cc4df0', '05c40011-d5e1-4691-ae7a-ad56b7348d04', 'ed24b8b8-a798-4cb3-b95b-4f881b7cf144'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:12 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:12 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:12 devstack sudo[85114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:03:12 devstack sudo[85114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:12 devstack sudo[85105]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-fa50481b-a887-41b1-ae6f-0fd6b30eb521 1073741824" returned: 0 in 1.061s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-fa50481b-a887-41b1-ae6f-0fd6b30eb521 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:12 devstack sudo[85126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-fa50481b-a887-41b1-ae6f-0fd6b30eb521 Feb 27 02:03:12 devstack sudo[85126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:12 devstack sudo[85114]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.630s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:12 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:12 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Deleted volume successfully. Feb 27 02:03:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14d2a439-ef68-4f6b-9f73-a858e0ad2a7b tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-4fcd31e9-8ab2-4606-98a7-5aff84f90554-delete_volume" released by "delete_volume" :: held 5.345s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:13 devstack sudo[85126]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-fa50481b-a887-41b1-ae6f-0fd6b30eb521" returned: 0 in 0.448s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.573s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "cinder-quobyte-3545e3c0-c2dd-4663-bd69-05217e3cb6f4-e9a49074-32aa-467a-b89e-d5307e6a5e46" by "_create_volume_from_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fa2d11-6f6f-4f5a-a0ee-79d2125119af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa50481b-a887-41b1-ae6f-0fd6b30eb521', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b8f9e2-70a0-476e-859b-55d50fed90d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-3545e3c0-c2dd-4663-bd69-05217e3cb6f4-e9a49074-32aa-467a-b89e-d5307e6a5e46" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Creating volume e9a49074-32aa-467a-b89e-d5307e6a5e46 from snapshot 3545e3c0-c2dd-4663-bd69-05217e3cb6f4 {{(pid=82683) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "cinder-quobyte-e9a49074-32aa-467a-b89e-d5307e6a5e46" by "_copy_volume_from_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:13 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Volume volume-fa50481b-a887-41b1-ae6f-0fd6b30eb521 (fa50481b-a887-41b1-ae6f-0fd6b30eb521): created successfully Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b8f9e2-70a0-476e-859b-55d50fed90d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Flow 'volume_create_manager' (8a4b0812-21b6-41c8-a327-fcda42486f68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-e9a49074-32aa-467a-b89e-d5307e6a5e46" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] snapshot: 3545e3c0-c2dd-4663-bd69-05217e3cb6f4, volume: e9a49074-32aa-467a-b89e-d5307e6a5e46, {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:13 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-a353cf64-6597-42f0-af06-fa2c86d4f6a0 tempest-ServersNegativeTestJSON-1858764089 None] Created volume successfully. Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e054d861-b910-4e69-b5a6-fece40bce861]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3a99426f-dd6f-4704-9b0d-2603ce7c7b1b tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "cinder-89432e53-4b2b-4f80-91ea-bc590e76bb05-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3a99426f-dd6f-4704-9b0d-2603ce7c7b1b tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-89432e53-4b2b-4f80-91ea-bc590e76bb05-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3a99426f-dd6f-4704-9b0d-2603ce7c7b1b tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "cinder-quobyte-89432e53-4b2b-4f80-91ea-bc590e76bb05" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3a99426f-dd6f-4704-9b0d-2603ce7c7b1b tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-89432e53-4b2b-4f80-91ea-bc590e76bb05" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01a7339-994f-4e02-93fd-99fd33fdc228]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3a99426f-dd6f-4704-9b0d-2603ce7c7b1b tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-89432e53-4b2b-4f80-91ea-bc590e76bb05 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:13 devstack sudo[85130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4 Feb 27 02:03:13 devstack sudo[85130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:13 devstack sudo[85131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-89432e53-4b2b-4f80-91ea-bc590e76bb05 Feb 27 02:03:13 devstack sudo[85131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:13 devstack sudo[85130]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4" returned: 0 in 0.689s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8192b62a-bbae-4922-8300-8ab7d7943601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] will copy from snapshot at /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601 {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Creating direct copy from snapshot {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[848341d7-ebd9-4b66-8b37-d54ccf59621e]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:13 devstack sudo[85131]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3a99426f-dd6f-4704-9b0d-2603ce7c7b1b tempest-VolumesDeleteCascade-1939462024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-89432e53-4b2b-4f80-91ea-bc590e76bb05" returned: 0 in 0.606s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3a99426f-dd6f-4704-9b0d-2603ce7c7b1b tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-89432e53-4b2b-4f80-91ea-bc590e76bb05 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:13 devstack sudo[85208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-89432e53-4b2b-4f80-91ea-bc590e76bb05 Feb 27 02:03:13 devstack sudo[85208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:14 devstack sudo[85207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601 Feb 27 02:03:14 devstack sudo[85207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:14 devstack sudo[85208]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3a99426f-dd6f-4704-9b0d-2603ce7c7b1b tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-89432e53-4b2b-4f80-91ea-bc590e76bb05" returned: 0 in 0.445s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:14 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3a99426f-dd6f-4704-9b0d-2603ce7c7b1b tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-quobyte-89432e53-4b2b-4f80-91ea-bc590e76bb05" released by "delete_volume" :: held 1.077s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:14 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-3a99426f-dd6f-4704-9b0d-2603ce7c7b1b tempest-VolumesDeleteCascade-1939462024 None] Created reservations ['1de2351a-8a32-4367-8ddf-178e300c28b3', '2e45229c-b24c-40a9-b06f-112b291d5d51', '48d02b40-d1e4-43da-b68e-15a739d3e7e2', '1d810a7c-6e3d-4a81-b1ba-cac588e2e875'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3a99426f-dd6f-4704-9b0d-2603ce7c7b1b tempest-VolumesDeleteCascade-1939462024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3a99426f-dd6f-4704-9b0d-2603ce7c7b1b tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-3a99426f-dd6f-4704-9b0d-2603ce7c7b1b tempest-VolumesDeleteCascade-1939462024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-3a99426f-dd6f-4704-9b0d-2603ce7c7b1b tempest-VolumesDeleteCascade-1939462024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3a99426f-dd6f-4704-9b0d-2603ce7c7b1b tempest-VolumesDeleteCascade-1939462024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3a99426f-dd6f-4704-9b0d-2603ce7c7b1b tempest-VolumesDeleteCascade-1939462024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:14 devstack sudo[85207]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601" returned: 0 in 0.642s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:14 devstack sudo[85215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:03:14 devstack cinder-volume[82683]: DEBUG cinder.utils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Path /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e9a49074-32aa-467a-b89e-d5307e6a5e46 not found in is_blk_device check {{(pid=82683) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:03:14 devstack sudo[85215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e9a49074-32aa-467a-b89e-d5307e6a5e46 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:14 devstack sudo[85217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e9a49074-32aa-467a-b89e-d5307e6a5e46 Feb 27 02:03:14 devstack sudo[85217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:15 devstack sudo[85215]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3a99426f-dd6f-4704-9b0d-2603ce7c7b1b tempest-VolumesDeleteCascade-1939462024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.595s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:15 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-3a99426f-dd6f-4704-9b0d-2603ce7c7b1b tempest-VolumesDeleteCascade-1939462024 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:15 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-3a99426f-dd6f-4704-9b0d-2603ce7c7b1b tempest-VolumesDeleteCascade-1939462024 None] Deleted volume successfully. Feb 27 02:03:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3a99426f-dd6f-4704-9b0d-2603ce7c7b1b tempest-VolumesDeleteCascade-1939462024 None] Lock "cinder-89432e53-4b2b-4f80-91ea-bc590e76bb05-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:15 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Flow 'volume_create_manager' (a9b85beb-3a59-4e7b-bdff-179b79c4f96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6a8561-018b-4e80-a1bc-7181b735a807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6a8561-018b-4e80-a1bc-7181b735a807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2001190542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a83afc-84c4-4c4b-9dfc-07513c349146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30bf490d6fb4cdfb54ed49346f30826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:16Z,use_quota=True,user_id='e35ded19fb0441e593907157315539aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb286da2-56df-437f-a242-418245a3a674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb286da2-56df-437f-a242-418245a3a674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb3b6d2-0267-4e31-92b3-20518b54c9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb3b6d2-0267-4e31-92b3-20518b54c9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0a83afc-84c4-4c4b-9dfc-07513c349146', 'volume_name': 'volume-d0a83afc-84c4-4c4b-9dfc-07513c349146', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0c5e71-9c1c-4cf5-88ea-b7e21fc8150d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0c5e71-9c1c-4cf5-88ea-b7e21fc8150d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62529b4e-f667-4db3-a2dd-9bb8966d85d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:16 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Volume d0a83afc-84c4-4c4b-9dfc-07513c349146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0a83afc-84c4-4c4b-9dfc-07513c349146', 'volume_size': 1} Feb 27 02:03:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:18 devstack sudo[85217]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e9a49074-32aa-467a-b89e-d5307e6a5e46" returned: 0 in 3.560s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:18 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89b25a8-34fe-4449-91be-7c55e5baffde]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:18 devstack sudo[85571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601 Feb 27 02:03:18 devstack sudo[85571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:19 devstack sudo[85571]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601" returned: 0 in 0.873s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:19 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Image conversion details: src /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601, size 1024.00 MB, duration 3.56 sec, destination /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e9a49074-32aa-467a-b89e-d5307e6a5e46 {{(pid=82683) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:03:19 devstack cinder-volume[82683]: INFO cinder.image.image_utils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Converted 1024.00 MB image at 287.54 MB/s Feb 27 02:03:19 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e9a49074-32aa-467a-b89e-d5307e6a5e46 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:03:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e9a49074-32aa-467a-b89e-d5307e6a5e46 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:19 devstack sudo[85577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e9a49074-32aa-467a-b89e-d5307e6a5e46 Feb 27 02:03:19 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:19 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e9a49074-32aa-467a-b89e-d5307e6a5e46" returned: 0 in 0.602s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:19 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-e9a49074-32aa-467a-b89e-d5307e6a5e46" released by "_copy_volume_from_snapshot" :: held 6.461s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:19 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-3545e3c0-c2dd-4663-bd69-05217e3cb6f4-e9a49074-32aa-467a-b89e-d5307e6a5e46" released by "_create_volume_from_snapshot" :: held 6.507s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.528s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.647s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2001190542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a83afc-84c4-4c4b-9dfc-07513c349146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a30bf490d6fb4cdfb54ed49346f30826',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:16Z,use_quota=True,user_id='e35ded19fb0441e593907157315539aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Creating volume d0a83afc-84c4-4c4b-9dfc-07513c349146 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:19 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:03:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d0a83afc-84c4-4c4b-9dfc-07513c349146 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:19 devstack sudo[85580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d0a83afc-84c4-4c4b-9dfc-07513c349146 1073741824 Feb 27 02:03:19 devstack sudo[85580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:19 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-240d99ed-1a85-4311-b204-f2f04eb29b7b tempest-GroupSnapshotsTest-487592209 None] Create group from source-snapshot-c08d53d7-2585-4df6-aa7b-d25e328394e5 completed successfully. Feb 27 02:03:20 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Flow 'volume_create_manager' (39b332ad-18af-4022-9d00-9be5bbace059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b9e359-c533-4b98-ac09-937ea9b4740a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b9e359-c533-4b98-ac09-937ea9b4740a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-206924245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0840a9-d6e9-4102-8e61-b6b61af16942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e923763a5d4ad899dfb504066c02b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:20Z,use_quota=True,user_id='ad0c335cdf66430f92fad43b6406c9b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e83382d1-a042-44eb-a621-33d5f2d855d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e83382d1-a042-44eb-a621-33d5f2d855d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7114474d-ad5f-47a7-97f1-e5790dc2b93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7114474d-ad5f-47a7-97f1-e5790dc2b93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b0840a9-d6e9-4102-8e61-b6b61af16942', 'volume_name': 'volume-0b0840a9-d6e9-4102-8e61-b6b61af16942', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65035fc6-bab8-4298-8f22-4df65f3a82e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65035fc6-bab8-4298-8f22-4df65f3a82e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607ad7ed-376e-4df8-8130-b2f39b3bb9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:20 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Volume 0b0840a9-d6e9-4102-8e61-b6b61af16942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b0840a9-d6e9-4102-8e61-b6b61af16942', 'volume_size': 1} Feb 27 02:03:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:20 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3a8eea4b-a1e4-444e-a563-a86a14365630 tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "cinder-quobyte-e9a49074-32aa-467a-b89e-d5307e6a5e46" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:20 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3a8eea4b-a1e4-444e-a563-a86a14365630 tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-e9a49074-32aa-467a-b89e-d5307e6a5e46" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:20 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2b1c4c-e788-411f-9b67-b21619acc72c]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3a8eea4b-a1e4-444e-a563-a86a14365630 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e9a49074-32aa-467a-b89e-d5307e6a5e46 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:20 devstack sudo[85585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e9a49074-32aa-467a-b89e-d5307e6a5e46 Feb 27 02:03:20 devstack sudo[85585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:20 devstack sudo[85580]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d0a83afc-84c4-4c4b-9dfc-07513c349146 1073741824" returned: 0 in 1.150s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d0a83afc-84c4-4c4b-9dfc-07513c349146 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:20 devstack sudo[85587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d0a83afc-84c4-4c4b-9dfc-07513c349146 Feb 27 02:03:20 devstack sudo[85587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:21 devstack sudo[85585]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3a8eea4b-a1e4-444e-a563-a86a14365630 tempest-GroupSnapshotsTest-487592209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e9a49074-32aa-467a-b89e-d5307e6a5e46" returned: 0 in 0.762s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3a8eea4b-a1e4-444e-a563-a86a14365630 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e9a49074-32aa-467a-b89e-d5307e6a5e46 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:21 devstack sudo[85592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e9a49074-32aa-467a-b89e-d5307e6a5e46 Feb 27 02:03:21 devstack sudo[85592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:21 devstack sudo[85587]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d0a83afc-84c4-4c4b-9dfc-07513c349146" returned: 0 in 0.592s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.160s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-206924245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0840a9-d6e9-4102-8e61-b6b61af16942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73e923763a5d4ad899dfb504066c02b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:20Z,use_quota=True,user_id='ad0c335cdf66430f92fad43b6406c9b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Creating volume 0b0840a9-d6e9-4102-8e61-b6b61af16942 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:21 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b0840a9-d6e9-4102-8e61-b6b61af16942 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62529b4e-f667-4db3-a2dd-9bb8966d85d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0a83afc-84c4-4c4b-9dfc-07513c349146', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ecfd0c1-7e5c-4b49-b091-55547d41e613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:21 devstack sudo[85595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b0840a9-d6e9-4102-8e61-b6b61af16942 1073741824 Feb 27 02:03:21 devstack sudo[85595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:21 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Volume volume-d0a83afc-84c4-4c4b-9dfc-07513c349146 (d0a83afc-84c4-4c4b-9dfc-07513c349146): created successfully Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ecfd0c1-7e5c-4b49-b091-55547d41e613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Flow 'volume_create_manager' (a9b85beb-3a59-4e7b-bdff-179b79c4f96b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:21 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-36304b7b-10c9-4f3d-9627-0fd0a345a5e6 tempest-ServersNegativeTestJSON-1858764089 None] Created volume successfully. Feb 27 02:03:21 devstack sudo[85592]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3a8eea4b-a1e4-444e-a563-a86a14365630 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e9a49074-32aa-467a-b89e-d5307e6a5e46" returned: 0 in 0.459s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3a8eea4b-a1e4-444e-a563-a86a14365630 tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-e9a49074-32aa-467a-b89e-d5307e6a5e46" released by "delete_volume" :: held 1.247s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-3a8eea4b-a1e4-444e-a563-a86a14365630 tempest-GroupSnapshotsTest-487592209 None] Created reservations ['b1438b1b-4eee-4969-8ef4-204e5ac1ecb8'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:21 devstack cinder-volume[82683]: WARNING cinder.quota [None req-3a8eea4b-a1e4-444e-a563-a86a14365630 tempest-GroupSnapshotsTest-487592209 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1101980838 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1101980838, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:03:21 devstack cinder-volume[82683]: WARNING cinder.quota [None req-3a8eea4b-a1e4-444e-a563-a86a14365630 tempest-GroupSnapshotsTest-487592209 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1101980838 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1101980838, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-3a8eea4b-a1e4-444e-a563-a86a14365630 tempest-GroupSnapshotsTest-487592209 None] Created reservations ['a02d03aa-47dc-492f-8887-bb9afef0232d', '329b17fd-1beb-4571-92ab-194c52d76d5a', '5046f6ca-629d-4805-bc18-2e085ddf0068', '8476346f-0a0e-4ffc-a499-acc8b7615f1b'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3a8eea4b-a1e4-444e-a563-a86a14365630 tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3a8eea4b-a1e4-444e-a563-a86a14365630 tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-3a8eea4b-a1e4-444e-a563-a86a14365630 tempest-GroupSnapshotsTest-487592209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-3a8eea4b-a1e4-444e-a563-a86a14365630 tempest-GroupSnapshotsTest-487592209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3a8eea4b-a1e4-444e-a563-a86a14365630 tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3a8eea4b-a1e4-444e-a563-a86a14365630 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:21 devstack sudo[85601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:03:21 devstack sudo[85601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:22 devstack sudo[85595]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b0840a9-d6e9-4102-8e61-b6b61af16942 1073741824" returned: 0 in 0.632s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b0840a9-d6e9-4102-8e61-b6b61af16942 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:22 devstack sudo[85603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b0840a9-d6e9-4102-8e61-b6b61af16942 Feb 27 02:03:22 devstack sudo[85603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:22 devstack sudo[85601]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3a8eea4b-a1e4-444e-a563-a86a14365630 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.618s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-3a8eea4b-a1e4-444e-a563-a86a14365630 tempest-GroupSnapshotsTest-487592209 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:22 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-3a8eea4b-a1e4-444e-a563-a86a14365630 tempest-GroupSnapshotsTest-487592209 None] Delete group completed successfully. Feb 27 02:03:22 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] group_snapshot c08d53d7-2585-4df6-aa7b-d25e328394e5: deleting Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] group_snapshot c08d53d7-2585-4df6-aa7b-d25e328394e5: deleting {{(pid=82683) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "cinder-quobyte-8192b62a-bbae-4922-8300-8ab7d7943601" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-8192b62a-bbae-4922-8300-8ab7d7943601" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "cinder-quobyte-3545e3c0-c2dd-4663-bd69-05217e3cb6f4" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-3545e3c0-c2dd-4663-bd69-05217e3cb6f4" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] Deleting offline snapshot 3545e3c0-c2dd-4663-bd69-05217e3cb6f4 of volume 8192b62a-bbae-4922-8300-8ab7d7943601 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] snapshot_file for this snap is: volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-30c7e235-e528-4302-aaeb-d83257238a81 tempest-ServersNegativeTestJSON-1858764089 None] Acquiring lock "cinder-d0a83afc-84c4-4c4b-9dfc-07513c349146-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[061da650-79f2-4d6b-97a8-98cace3ee1f8]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-30c7e235-e528-4302-aaeb-d83257238a81 tempest-ServersNegativeTestJSON-1858764089 None] Lock "cinder-d0a83afc-84c4-4c4b-9dfc-07513c349146-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-30c7e235-e528-4302-aaeb-d83257238a81 tempest-ServersNegativeTestJSON-1858764089 None] Acquiring lock "cinder-quobyte-d0a83afc-84c4-4c4b-9dfc-07513c349146" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-30c7e235-e528-4302-aaeb-d83257238a81 tempest-ServersNegativeTestJSON-1858764089 None] Lock "cinder-quobyte-d0a83afc-84c4-4c4b-9dfc-07513c349146" acquired by "delete_volume" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[40014de0-cd2c-478b-a71b-e945e9094760]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-30c7e235-e528-4302-aaeb-d83257238a81 tempest-ServersNegativeTestJSON-1858764089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d0a83afc-84c4-4c4b-9dfc-07513c349146 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:22 devstack sudo[85603]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b0840a9-d6e9-4102-8e61-b6b61af16942" returned: 0 in 0.847s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607ad7ed-376e-4df8-8130-b2f39b3bb9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b0840a9-d6e9-4102-8e61-b6b61af16942', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3bc403e-77bf-4a7a-ad4e-cf118ca73493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:23 devstack sudo[85607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4 Feb 27 02:03:23 devstack sudo[85607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:23 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Volume volume-0b0840a9-d6e9-4102-8e61-b6b61af16942 (0b0840a9-d6e9-4102-8e61-b6b61af16942): created successfully Feb 27 02:03:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3bc403e-77bf-4a7a-ad4e-cf118ca73493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Flow 'volume_create_manager' (39b332ad-18af-4022-9d00-9be5bbace059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:23 devstack sudo[85608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d0a83afc-84c4-4c4b-9dfc-07513c349146 Feb 27 02:03:23 devstack sudo[85608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:23 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-5ddd64dc-d0c9-4e7b-ac41-f84481108e23 tempest-VolumesMetadataTest-840435333 None] Created volume successfully. Feb 27 02:03:23 devstack sudo[85607]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4" returned: 0 in 0.679s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:23 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8192b62a-bbae-4922-8300-8ab7d7943601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:23 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[356bf0af-c8a7-42a0-b796-c99caf3fe397]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:23 devstack sudo[85617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601 Feb 27 02:03:23 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:23 devstack sudo[85608]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-30c7e235-e528-4302-aaeb-d83257238a81 tempest-ServersNegativeTestJSON-1858764089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d0a83afc-84c4-4c4b-9dfc-07513c349146" returned: 0 in 0.703s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-30c7e235-e528-4302-aaeb-d83257238a81 tempest-ServersNegativeTestJSON-1858764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d0a83afc-84c4-4c4b-9dfc-07513c349146 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:23 devstack sudo[85619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d0a83afc-84c4-4c4b-9dfc-07513c349146 Feb 27 02:03:23 devstack sudo[85619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:24 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1c3a02d8-bef4-4e0b-92d6-90820e1ecc36 tempest-VolumesMetadataTest-840435333 None] Acquiring lock "cinder-0b0840a9-d6e9-4102-8e61-b6b61af16942-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:24 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1c3a02d8-bef4-4e0b-92d6-90820e1ecc36 tempest-VolumesMetadataTest-840435333 None] Lock "cinder-0b0840a9-d6e9-4102-8e61-b6b61af16942-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:24 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1c3a02d8-bef4-4e0b-92d6-90820e1ecc36 tempest-VolumesMetadataTest-840435333 None] Acquiring lock "cinder-quobyte-0b0840a9-d6e9-4102-8e61-b6b61af16942" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:24 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1c3a02d8-bef4-4e0b-92d6-90820e1ecc36 tempest-VolumesMetadataTest-840435333 None] Lock "cinder-quobyte-0b0840a9-d6e9-4102-8e61-b6b61af16942" acquired by "delete_volume" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:24 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1466bfff-d4d7-4bfe-a627-5fcb11df033f]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1c3a02d8-bef4-4e0b-92d6-90820e1ecc36 tempest-VolumesMetadataTest-840435333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b0840a9-d6e9-4102-8e61-b6b61af16942 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:24 devstack sudo[85622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b0840a9-d6e9-4102-8e61-b6b61af16942 Feb 27 02:03:24 devstack sudo[85622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:24 devstack sudo[85619]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-30c7e235-e528-4302-aaeb-d83257238a81 tempest-ServersNegativeTestJSON-1858764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d0a83afc-84c4-4c4b-9dfc-07513c349146" returned: 0 in 0.597s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:24 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-30c7e235-e528-4302-aaeb-d83257238a81 tempest-ServersNegativeTestJSON-1858764089 None] Lock "cinder-quobyte-d0a83afc-84c4-4c4b-9dfc-07513c349146" released by "delete_volume" :: held 1.333s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:24 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-30c7e235-e528-4302-aaeb-d83257238a81 tempest-ServersNegativeTestJSON-1858764089 None] Created reservations ['fdc0077b-d779-4329-bc7a-9b5ae054f536', '095b91ab-1e06-4cff-a2b0-25b246dc4475', '7518cdd9-0910-4d58-9f82-5e472bbf0820', '36f41a98-731b-480f-8d7e-4decf0ffbb83'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-30c7e235-e528-4302-aaeb-d83257238a81 tempest-ServersNegativeTestJSON-1858764089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-30c7e235-e528-4302-aaeb-d83257238a81 tempest-ServersNegativeTestJSON-1858764089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:24 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-30c7e235-e528-4302-aaeb-d83257238a81 tempest-ServersNegativeTestJSON-1858764089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:24 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-30c7e235-e528-4302-aaeb-d83257238a81 tempest-ServersNegativeTestJSON-1858764089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-30c7e235-e528-4302-aaeb-d83257238a81 tempest-ServersNegativeTestJSON-1858764089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-30c7e235-e528-4302-aaeb-d83257238a81 tempest-ServersNegativeTestJSON-1858764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:24 devstack sudo[85629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:03:24 devstack sudo[85629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:24 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601" returned: 0 in 0.891s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:24 devstack sudo[85631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4 Feb 27 02:03:24 devstack sudo[85631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:25 devstack sudo[85622]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1c3a02d8-bef4-4e0b-92d6-90820e1ecc36 tempest-VolumesMetadataTest-840435333 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b0840a9-d6e9-4102-8e61-b6b61af16942" returned: 0 in 0.850s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1c3a02d8-bef4-4e0b-92d6-90820e1ecc36 tempest-VolumesMetadataTest-840435333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b0840a9-d6e9-4102-8e61-b6b61af16942 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:25 devstack sudo[85658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b0840a9-d6e9-4102-8e61-b6b61af16942 Feb 27 02:03:25 devstack sudo[85658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:25 devstack sudo[85629]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-30c7e235-e528-4302-aaeb-d83257238a81 tempest-ServersNegativeTestJSON-1858764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.720s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-30c7e235-e528-4302-aaeb-d83257238a81 tempest-ServersNegativeTestJSON-1858764089 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:25 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-30c7e235-e528-4302-aaeb-d83257238a81 tempest-ServersNegativeTestJSON-1858764089 None] Deleted volume successfully. Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-30c7e235-e528-4302-aaeb-d83257238a81 tempest-ServersNegativeTestJSON-1858764089 None] Lock "cinder-d0a83afc-84c4-4c4b-9dfc-07513c349146-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-242c2750-98f5-4866-bc61-5173fd964eb4 tempest-ServersNegativeTestJSON-1858764089 None] Acquiring lock "cinder-fa50481b-a887-41b1-ae6f-0fd6b30eb521-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-242c2750-98f5-4866-bc61-5173fd964eb4 tempest-ServersNegativeTestJSON-1858764089 None] Lock "cinder-fa50481b-a887-41b1-ae6f-0fd6b30eb521-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-242c2750-98f5-4866-bc61-5173fd964eb4 tempest-ServersNegativeTestJSON-1858764089 None] Acquiring lock "cinder-quobyte-fa50481b-a887-41b1-ae6f-0fd6b30eb521" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-242c2750-98f5-4866-bc61-5173fd964eb4 tempest-ServersNegativeTestJSON-1858764089 None] Lock "cinder-quobyte-fa50481b-a887-41b1-ae6f-0fd6b30eb521" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2774c14f-d753-4069-89a4-c28700d1ec98]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-242c2750-98f5-4866-bc61-5173fd964eb4 tempest-ServersNegativeTestJSON-1858764089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-fa50481b-a887-41b1-ae6f-0fd6b30eb521 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:25 devstack sudo[85631]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4" returned: 0 in 0.982s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:25 devstack sudo[85665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4 Feb 27 02:03:25 devstack sudo[85665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:25 devstack sudo[85663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-fa50481b-a887-41b1-ae6f-0fd6b30eb521 Feb 27 02:03:25 devstack sudo[85663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:25 devstack sudo[85658]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1c3a02d8-bef4-4e0b-92d6-90820e1ecc36 tempest-VolumesMetadataTest-840435333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b0840a9-d6e9-4102-8e61-b6b61af16942" returned: 0 in 0.622s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1c3a02d8-bef4-4e0b-92d6-90820e1ecc36 tempest-VolumesMetadataTest-840435333 None] Lock "cinder-quobyte-0b0840a9-d6e9-4102-8e61-b6b61af16942" released by "delete_volume" :: held 1.498s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-1c3a02d8-bef4-4e0b-92d6-90820e1ecc36 tempest-VolumesMetadataTest-840435333 None] Created reservations ['5cdfce53-cf11-476a-8e7a-035f1a9b3e54', '8b2c2f12-57e1-4447-8e2b-0880ab7e371a', '338e27ae-64d5-49ed-a902-abfd02a064bd', 'b017266b-b448-4e86-8e70-9df2bd41c645'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1c3a02d8-bef4-4e0b-92d6-90820e1ecc36 tempest-VolumesMetadataTest-840435333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1c3a02d8-bef4-4e0b-92d6-90820e1ecc36 tempest-VolumesMetadataTest-840435333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1c3a02d8-bef4-4e0b-92d6-90820e1ecc36 tempest-VolumesMetadataTest-840435333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1c3a02d8-bef4-4e0b-92d6-90820e1ecc36 tempest-VolumesMetadataTest-840435333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1c3a02d8-bef4-4e0b-92d6-90820e1ecc36 tempest-VolumesMetadataTest-840435333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1c3a02d8-bef4-4e0b-92d6-90820e1ecc36 tempest-VolumesMetadataTest-840435333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:25 devstack sudo[85676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:03:25 devstack sudo[85676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:26 devstack sudo[85665]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601.3545e3c0-c2dd-4663-bd69-05217e3cb6f4" returned: 0 in 0.552s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:26 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-3545e3c0-c2dd-4663-bd69-05217e3cb6f4" released by "_delete_snapshot" :: held 3.196s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:26 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-8192b62a-bbae-4922-8300-8ab7d7943601" released by "delete_snapshot" :: held 3.208s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:26 devstack sudo[85663]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-242c2750-98f5-4866-bc61-5173fd964eb4 tempest-ServersNegativeTestJSON-1858764089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-fa50481b-a887-41b1-ae6f-0fd6b30eb521" returned: 0 in 0.676s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-242c2750-98f5-4866-bc61-5173fd964eb4 tempest-ServersNegativeTestJSON-1858764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-fa50481b-a887-41b1-ae6f-0fd6b30eb521 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:26 devstack sudo[85687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-fa50481b-a887-41b1-ae6f-0fd6b30eb521 Feb 27 02:03:26 devstack sudo[85687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:26 devstack cinder-volume[82683]: WARNING cinder.quota [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1101980838 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1101980838, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:03:26 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] Created reservations ['8b2b116e-31f4-4a81-bb3f-c0c680834b35', 'c5befa09-f30a-4d81-bc92-f38e6d453f10', '1f712e5d-046f-4c7d-b134-c33ebdde3420', '9700dde8-c95d-4f82-b563-7e3e30fc91fc'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:26 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-b12ab997-f8bd-4a0f-9320-9629b4cb403f tempest-GroupSnapshotsTest-487592209 None] group_snapshot c08d53d7-2585-4df6-aa7b-d25e328394e5: deleted successfully Feb 27 02:03:26 devstack sudo[85676]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1c3a02d8-bef4-4e0b-92d6-90820e1ecc36 tempest-VolumesMetadataTest-840435333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.568s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:26 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-1c3a02d8-bef4-4e0b-92d6-90820e1ecc36 tempest-VolumesMetadataTest-840435333 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:26 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-1c3a02d8-bef4-4e0b-92d6-90820e1ecc36 tempest-VolumesMetadataTest-840435333 None] Deleted volume successfully. Feb 27 02:03:26 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1c3a02d8-bef4-4e0b-92d6-90820e1ecc36 tempest-VolumesMetadataTest-840435333 None] Lock "cinder-0b0840a9-d6e9-4102-8e61-b6b61af16942-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:26 devstack sudo[85687]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-242c2750-98f5-4866-bc61-5173fd964eb4 tempest-ServersNegativeTestJSON-1858764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-fa50481b-a887-41b1-ae6f-0fd6b30eb521" returned: 0 in 0.514s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:26 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-242c2750-98f5-4866-bc61-5173fd964eb4 tempest-ServersNegativeTestJSON-1858764089 None] Lock "cinder-quobyte-fa50481b-a887-41b1-ae6f-0fd6b30eb521" released by "delete_volume" :: held 1.220s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:26 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-242c2750-98f5-4866-bc61-5173fd964eb4 tempest-ServersNegativeTestJSON-1858764089 None] Created reservations ['d365279d-e388-41d4-8bd3-71f85cc4ea75', '897248c2-d4d2-4879-8216-9df7f3a8732e', 'f202128c-f688-40e7-963a-569418e48a12', 'a5154f49-143c-4fd2-9017-0cd2cccd0c55'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-242c2750-98f5-4866-bc61-5173fd964eb4 tempest-ServersNegativeTestJSON-1858764089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-242c2750-98f5-4866-bc61-5173fd964eb4 tempest-ServersNegativeTestJSON-1858764089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:26 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-242c2750-98f5-4866-bc61-5173fd964eb4 tempest-ServersNegativeTestJSON-1858764089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:26 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-242c2750-98f5-4866-bc61-5173fd964eb4 tempest-ServersNegativeTestJSON-1858764089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-242c2750-98f5-4866-bc61-5173fd964eb4 tempest-ServersNegativeTestJSON-1858764089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-242c2750-98f5-4866-bc61-5173fd964eb4 tempest-ServersNegativeTestJSON-1858764089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:26 devstack sudo[85703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:03:26 devstack sudo[85703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:27 devstack sudo[85703]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-242c2750-98f5-4866-bc61-5173fd964eb4 tempest-ServersNegativeTestJSON-1858764089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.478s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:27 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-242c2750-98f5-4866-bc61-5173fd964eb4 tempest-ServersNegativeTestJSON-1858764089 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:27 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-242c2750-98f5-4866-bc61-5173fd964eb4 tempest-ServersNegativeTestJSON-1858764089 None] Deleted volume successfully. Feb 27 02:03:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-242c2750-98f5-4866-bc61-5173fd964eb4 tempest-ServersNegativeTestJSON-1858764089 None] Lock "cinder-fa50481b-a887-41b1-ae6f-0fd6b30eb521-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5c4d1850-3b0f-4b02-a0fb-52bcd7ad9379 tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "cinder-quobyte-8192b62a-bbae-4922-8300-8ab7d7943601" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5c4d1850-3b0f-4b02-a0fb-52bcd7ad9379 tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-8192b62a-bbae-4922-8300-8ab7d7943601" acquired by "delete_volume" :: waited 0.024s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:27 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[500180ec-13f8-45e5-b33b-d7087cf93b05]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5c4d1850-3b0f-4b02-a0fb-52bcd7ad9379 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:27 devstack sudo[85714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601 Feb 27 02:03:27 devstack sudo[85714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:28 devstack sudo[85714]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5c4d1850-3b0f-4b02-a0fb-52bcd7ad9379 tempest-GroupSnapshotsTest-487592209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601" returned: 0 in 0.699s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5c4d1850-3b0f-4b02-a0fb-52bcd7ad9379 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:28 devstack sudo[85720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601 Feb 27 02:03:28 devstack sudo[85720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:28 devstack sudo[85720]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5c4d1850-3b0f-4b02-a0fb-52bcd7ad9379 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8192b62a-bbae-4922-8300-8ab7d7943601" returned: 0 in 0.462s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:28 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5c4d1850-3b0f-4b02-a0fb-52bcd7ad9379 tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-8192b62a-bbae-4922-8300-8ab7d7943601" released by "delete_volume" :: held 1.198s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:28 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-5c4d1850-3b0f-4b02-a0fb-52bcd7ad9379 tempest-GroupSnapshotsTest-487592209 None] Created reservations ['8383f635-1806-44a1-b3ff-a914179ac142'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:28 devstack cinder-volume[82683]: WARNING cinder.db.sqlalchemy.api [None req-5c4d1850-3b0f-4b02-a0fb-52bcd7ad9379 tempest-GroupSnapshotsTest-487592209 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1101980838'] Feb 27 02:03:28 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-5c4d1850-3b0f-4b02-a0fb-52bcd7ad9379 tempest-GroupSnapshotsTest-487592209 None] Created reservations ['d58e5323-6600-4444-b5e3-559f751c15a0', '24044614-460d-4731-b1ed-3b28cf7380b2', '4c70800c-a13e-44b1-b885-600724670655', '03ef4b5f-e86b-4fd5-9163-b378c8ef0e20'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5c4d1850-3b0f-4b02-a0fb-52bcd7ad9379 tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5c4d1850-3b0f-4b02-a0fb-52bcd7ad9379 tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:28 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5c4d1850-3b0f-4b02-a0fb-52bcd7ad9379 tempest-GroupSnapshotsTest-487592209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:28 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5c4d1850-3b0f-4b02-a0fb-52bcd7ad9379 tempest-GroupSnapshotsTest-487592209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5c4d1850-3b0f-4b02-a0fb-52bcd7ad9379 tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5c4d1850-3b0f-4b02-a0fb-52bcd7ad9379 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:28 devstack sudo[85733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:03:28 devstack sudo[85733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:29 devstack sudo[85733]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5c4d1850-3b0f-4b02-a0fb-52bcd7ad9379 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.620s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-5c4d1850-3b0f-4b02-a0fb-52bcd7ad9379 tempest-GroupSnapshotsTest-487592209 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:29 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-5c4d1850-3b0f-4b02-a0fb-52bcd7ad9379 tempest-GroupSnapshotsTest-487592209 None] Delete group completed successfully. Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Flow 'volume_create_manager' (cfcd4a7a-0305-45e8-93e9-9cf11c4f9ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e002646-35b3-422e-bfb3-d8cd654ccebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e002646-35b3-422e-bfb3-d8cd654ccebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-878855738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e7733e7-03cc-4941-bd1e-a163c6a8c70b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caedc3d8ad5f4ceeb304eb2cea0a2435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:30Z,use_quota=True,user_id='11b3d641312140e1afd3e127b91ee3e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547b9b88-ea7c-47c1-828d-ae9ee2a24aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547b9b88-ea7c-47c1-828d-ae9ee2a24aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe669e6a-866e-413d-9fc5-e7b1c861b438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe669e6a-866e-413d-9fc5-e7b1c861b438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e7733e7-03cc-4941-bd1e-a163c6a8c70b', 'volume_name': 'volume-1e7733e7-03cc-4941-bd1e-a163c6a8c70b', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c65feb-0de5-491f-956b-b91b2c551b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c65feb-0de5-491f-956b-b91b2c551b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807bfe28-b921-4bbc-9ee5-03a0184c60e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:29 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Volume 1e7733e7-03cc-4941-bd1e-a163c6a8c70b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e7733e7-03cc-4941-bd1e-a163c6a8c70b', 'volume_size': 1} Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-878855738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e7733e7-03cc-4941-bd1e-a163c6a8c70b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caedc3d8ad5f4ceeb304eb2cea0a2435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:30Z,use_quota=True,user_id='11b3d641312140e1afd3e127b91ee3e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Creating volume 1e7733e7-03cc-4941-bd1e-a163c6a8c70b {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:29 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:03:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1e7733e7-03cc-4941-bd1e-a163c6a8c70b 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:29 devstack sudo[85761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1e7733e7-03cc-4941-bd1e-a163c6a8c70b 1073741824 Feb 27 02:03:29 devstack sudo[85761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:29 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-78d3ca97-aff3-4022-90a3-af5d8e0670d1 tempest-GroupSnapshotsTest-487592209 None] Group tempest-GroupSnapshotsTest-Group-1265413309: creating Feb 27 02:03:29 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-78d3ca97-aff3-4022-90a3-af5d8e0670d1 tempest-GroupSnapshotsTest-487592209 None] Group tempest-GroupSnapshotsTest-Group-1265413309: created successfully Feb 27 02:03:29 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-78d3ca97-aff3-4022-90a3-af5d8e0670d1 tempest-GroupSnapshotsTest-487592209 None] Create group completed successfully. Feb 27 02:03:30 devstack sudo[85761]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1e7733e7-03cc-4941-bd1e-a163c6a8c70b 1073741824" returned: 0 in 0.584s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1e7733e7-03cc-4941-bd1e-a163c6a8c70b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:30 devstack sudo[85766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1e7733e7-03cc-4941-bd1e-a163c6a8c70b Feb 27 02:03:30 devstack sudo[85766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:30 devstack sudo[85766]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1e7733e7-03cc-4941-bd1e-a163c6a8c70b" returned: 0 in 0.474s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:30 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807bfe28-b921-4bbc-9ee5-03a0184c60e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e7733e7-03cc-4941-bd1e-a163c6a8c70b', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34e00da-915b-4d6c-8705-c211602f0b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:30 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Volume volume-1e7733e7-03cc-4941-bd1e-a163c6a8c70b (1e7733e7-03cc-4941-bd1e-a163c6a8c70b): created successfully Feb 27 02:03:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34e00da-915b-4d6c-8705-c211602f0b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Flow 'volume_create_manager' (cfcd4a7a-0305-45e8-93e9-9cf11c4f9ac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:30 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-d6a38604-3741-4801-8756-2ae85cfa279a tempest-VolumesTransfersV355Test-1643455606 None] Created volume successfully. Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Flow 'volume_create_manager' (36967921-d3ca-4f9a-89df-3fbf74d05df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37f058c-311d-415c-aeea-beddea8ee116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37f058c-311d-415c-aeea-beddea8ee116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-819785788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=936fe25e-816e-42fa-95fc-369e959c4b67,host='devstack@QuobyteHD#QuobyteHD',id=c3ab7d79-b804-4dd2-8309-13869bb165f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56d45f666c694f60955bdf68e51b9af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:31Z,use_quota=True,user_id='11c4672cca1b480a9438ee0fb1550fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92f1b7f6-4797-49d9-864a-654814752fe8),volume_type_id=92f1b7f6-4797-49d9-864a-654814752fe8)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588ae6f7-7b7d-4706-b8a2-b582bb69af5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588ae6f7-7b7d-4706-b8a2-b582bb69af5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddada777-e66d-4feb-9f47-912e4725f539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddada777-e66d-4feb-9f47-912e4725f539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3ab7d79-b804-4dd2-8309-13869bb165f4', 'volume_name': 'volume-c3ab7d79-b804-4dd2-8309-13869bb165f4', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5d65ba-5cda-4ffd-8e9c-dde29a0bea4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5d65ba-5cda-4ffd-8e9c-dde29a0bea4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b5f207-457a-4390-8a13-a00e37d06e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:31 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Volume c3ab7d79-b804-4dd2-8309-13869bb165f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3ab7d79-b804-4dd2-8309-13869bb165f4', 'volume_size': 1} Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=936fe25e-816e-42fa-95fc-369e959c4b67,created_at=2026-02-27T01:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-819785788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=936fe25e-816e-42fa-95fc-369e959c4b67,host='devstack@QuobyteHD#QuobyteHD',id=c3ab7d79-b804-4dd2-8309-13869bb165f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56d45f666c694f60955bdf68e51b9af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:31Z,use_quota=True,user_id='11c4672cca1b480a9438ee0fb1550fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92f1b7f6-4797-49d9-864a-654814752fe8),volume_type_id=92f1b7f6-4797-49d9-864a-654814752fe8)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Creating volume c3ab7d79-b804-4dd2-8309-13869bb165f4 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:31 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:03:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:31 devstack sudo[85796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4 1073741824 Feb 27 02:03:31 devstack sudo[85796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:32 devstack sudo[85796]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4 1073741824" returned: 0 in 0.973s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:32 devstack sudo[85802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4 Feb 27 02:03:32 devstack sudo[85802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:32 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-e988e58f-30fa-4986-a0e4-ca13e7bdb7a6 tempest-VolumesTransfersV355Test-775422436 None] Transfer volume completed successfully. Feb 27 02:03:32 devstack sudo[85802]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4" returned: 0 in 0.479s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:32 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b5f207-457a-4390-8a13-a00e37d06e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3ab7d79-b804-4dd2-8309-13869bb165f4', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af960823-391d-4d6a-b858-39c7e0826936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:32 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Volume volume-c3ab7d79-b804-4dd2-8309-13869bb165f4 (c3ab7d79-b804-4dd2-8309-13869bb165f4): created successfully Feb 27 02:03:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af960823-391d-4d6a-b858-39c7e0826936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Flow 'volume_create_manager' (36967921-d3ca-4f9a-89df-3fbf74d05df1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:33 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-eb85d791-0aec-4486-88ed-0f9fbe9902da tempest-GroupSnapshotsTest-487592209 None] Created volume successfully. Feb 27 02:03:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-83538619-dc02-43c1-91ae-6930786b87b7 tempest-VolumesTransfersV355Test-1874574990 None] Acquiring lock "cinder-1e7733e7-03cc-4941-bd1e-a163c6a8c70b-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-83538619-dc02-43c1-91ae-6930786b87b7 tempest-VolumesTransfersV355Test-1874574990 None] Lock "cinder-1e7733e7-03cc-4941-bd1e-a163c6a8c70b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-83538619-dc02-43c1-91ae-6930786b87b7 tempest-VolumesTransfersV355Test-1874574990 None] Acquiring lock "cinder-quobyte-1e7733e7-03cc-4941-bd1e-a163c6a8c70b" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-83538619-dc02-43c1-91ae-6930786b87b7 tempest-VolumesTransfersV355Test-1874574990 None] Lock "cinder-quobyte-1e7733e7-03cc-4941-bd1e-a163c6a8c70b" acquired by "delete_volume" :: waited 0.020s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:33 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[44edf473-22ed-45c3-9e29-3f65376f7dab]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83538619-dc02-43c1-91ae-6930786b87b7 tempest-VolumesTransfersV355Test-1874574990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1e7733e7-03cc-4941-bd1e-a163c6a8c70b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:33 devstack sudo[85805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1e7733e7-03cc-4941-bd1e-a163c6a8c70b Feb 27 02:03:33 devstack sudo[85805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:33 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Flow 'volume_create_manager' (27b962a5-89a8-4c7b-bc78-381ee3024bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3624bf12-67ce-4587-b546-1cb501c266a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3624bf12-67ce-4587-b546-1cb501c266a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1952996813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=936fe25e-816e-42fa-95fc-369e959c4b67,host='devstack@QuobyteHD#QuobyteHD',id=7a214615-9b11-43cf-a84a-b61a7a17cef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56d45f666c694f60955bdf68e51b9af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:34Z,use_quota=True,user_id='11c4672cca1b480a9438ee0fb1550fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92f1b7f6-4797-49d9-864a-654814752fe8),volume_type_id=92f1b7f6-4797-49d9-864a-654814752fe8)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d42bac-e478-49a5-9d5d-840460e84ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d42bac-e478-49a5-9d5d-840460e84ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5b6f4c-8e40-4794-a458-a5c96c25f1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5b6f4c-8e40-4794-a458-a5c96c25f1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a214615-9b11-43cf-a84a-b61a7a17cef7', 'volume_name': 'volume-7a214615-9b11-43cf-a84a-b61a7a17cef7', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9406ec9-132e-4f12-a15d-d500565c4c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9406ec9-132e-4f12-a15d-d500565c4c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb0bc45-b543-4fe4-8458-32556b022382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:34 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Volume 7a214615-9b11-43cf-a84a-b61a7a17cef7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a214615-9b11-43cf-a84a-b61a7a17cef7', 'volume_size': 1} Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=936fe25e-816e-42fa-95fc-369e959c4b67,created_at=2026-02-27T01:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1952996813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=936fe25e-816e-42fa-95fc-369e959c4b67,host='devstack@QuobyteHD#QuobyteHD',id=7a214615-9b11-43cf-a84a-b61a7a17cef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56d45f666c694f60955bdf68e51b9af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:34Z,use_quota=True,user_id='11c4672cca1b480a9438ee0fb1550fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92f1b7f6-4797-49d9-864a-654814752fe8),volume_type_id=92f1b7f6-4797-49d9-864a-654814752fe8)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Creating volume 7a214615-9b11-43cf-a84a-b61a7a17cef7 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:34 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:34 devstack sudo[85831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7 1073741824 Feb 27 02:03:34 devstack sudo[85831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:34 devstack sudo[85805]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83538619-dc02-43c1-91ae-6930786b87b7 tempest-VolumesTransfersV355Test-1874574990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1e7733e7-03cc-4941-bd1e-a163c6a8c70b" returned: 0 in 0.689s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83538619-dc02-43c1-91ae-6930786b87b7 tempest-VolumesTransfersV355Test-1874574990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1e7733e7-03cc-4941-bd1e-a163c6a8c70b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:34 devstack sudo[85836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1e7733e7-03cc-4941-bd1e-a163c6a8c70b Feb 27 02:03:34 devstack sudo[85836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:34 devstack sudo[85831]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7 1073741824" returned: 0 in 0.774s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:34 devstack sudo[85842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7 Feb 27 02:03:34 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:34 devstack sudo[85836]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83538619-dc02-43c1-91ae-6930786b87b7 tempest-VolumesTransfersV355Test-1874574990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1e7733e7-03cc-4941-bd1e-a163c6a8c70b" returned: 0 in 0.610s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:34 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-83538619-dc02-43c1-91ae-6930786b87b7 tempest-VolumesTransfersV355Test-1874574990 None] Lock "cinder-quobyte-1e7733e7-03cc-4941-bd1e-a163c6a8c70b" released by "delete_volume" :: held 1.338s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:35 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-83538619-dc02-43c1-91ae-6930786b87b7 tempest-VolumesTransfersV355Test-1874574990 None] Created reservations ['c6e063db-72bc-4e67-b944-7016905b2174', '528ffb7d-85a7-42b7-b27f-d95d3deaced2', '210bb2b9-95b0-4a46-98d0-529887940460', 'c0eb9095-df81-4d92-a86a-9734db8db63b'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-83538619-dc02-43c1-91ae-6930786b87b7 tempest-VolumesTransfersV355Test-1874574990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-83538619-dc02-43c1-91ae-6930786b87b7 tempest-VolumesTransfersV355Test-1874574990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:35 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-83538619-dc02-43c1-91ae-6930786b87b7 tempest-VolumesTransfersV355Test-1874574990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:35 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-83538619-dc02-43c1-91ae-6930786b87b7 tempest-VolumesTransfersV355Test-1874574990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-83538619-dc02-43c1-91ae-6930786b87b7 tempest-VolumesTransfersV355Test-1874574990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83538619-dc02-43c1-91ae-6930786b87b7 tempest-VolumesTransfersV355Test-1874574990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:35 devstack sudo[85844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:03:35 devstack sudo[85844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:35 devstack sudo[85844]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83538619-dc02-43c1-91ae-6930786b87b7 tempest-VolumesTransfersV355Test-1874574990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.501s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:35 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-83538619-dc02-43c1-91ae-6930786b87b7 tempest-VolumesTransfersV355Test-1874574990 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:35 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-83538619-dc02-43c1-91ae-6930786b87b7 tempest-VolumesTransfersV355Test-1874574990 None] Deleted volume successfully. Feb 27 02:03:35 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7" returned: 0 in 0.843s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:35 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:35 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb0bc45-b543-4fe4-8458-32556b022382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a214615-9b11-43cf-a84a-b61a7a17cef7', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:35 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15bb6c5-8674-4acd-897e-8b14ebb1ec04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:35 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-83538619-dc02-43c1-91ae-6930786b87b7 tempest-VolumesTransfersV355Test-1874574990 None] Lock "cinder-1e7733e7-03cc-4941-bd1e-a163c6a8c70b-delete_volume" released by "delete_volume" :: held 2.172s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:35 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Volume volume-7a214615-9b11-43cf-a84a-b61a7a17cef7 (7a214615-9b11-43cf-a84a-b61a7a17cef7): created successfully Feb 27 02:03:35 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15bb6c5-8674-4acd-897e-8b14ebb1ec04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:35 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Flow 'volume_create_manager' (27b962a5-89a8-4c7b-bc78-381ee3024bbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:35 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-92df0870-f28b-47b0-a955-9555fedabe2e tempest-GroupSnapshotsTest-487592209 None] Created volume successfully. Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Flow 'volume_create_manager' (d2ef5f08-51c9-44f4-81c8-69911b7f732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c4fc37-798b-4afc-bef4-c3e95bf4b5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c4fc37-798b-4afc-bef4-c3e95bf4b5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-963610481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9c86a7-a482-4e29-a121-21805e5d6e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caedc3d8ad5f4ceeb304eb2cea0a2435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:36Z,use_quota=True,user_id='11b3d641312140e1afd3e127b91ee3e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96eb61c-11fc-478d-92a6-2e143557c3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96eb61c-11fc-478d-92a6-2e143557c3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b5bd4c6-e32a-45a0-adbe-a1ed0f12f17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b5bd4c6-e32a-45a0-adbe-a1ed0f12f17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a9c86a7-a482-4e29-a121-21805e5d6e87', 'volume_name': 'volume-7a9c86a7-a482-4e29-a121-21805e5d6e87', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b91cef-9bbb-478f-846b-6c0082c9effb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b91cef-9bbb-478f-846b-6c0082c9effb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff28bff-d377-4262-a9ed-dc2bf0e5e30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:36 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Volume 7a9c86a7-a482-4e29-a121-21805e5d6e87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a9c86a7-a482-4e29-a121-21805e5d6e87', 'volume_size': 1} Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-963610481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9c86a7-a482-4e29-a121-21805e5d6e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caedc3d8ad5f4ceeb304eb2cea0a2435',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:36Z,use_quota=True,user_id='11b3d641312140e1afd3e127b91ee3e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Creating volume 7a9c86a7-a482-4e29-a121-21805e5d6e87 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:36 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a9c86a7-a482-4e29-a121-21805e5d6e87 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:36 devstack sudo[85849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a9c86a7-a482-4e29-a121-21805e5d6e87 1073741824 Feb 27 02:03:36 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:36 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-84fcdbbd-5470-46c5-bf14-dfebb0eac9b1 tempest-GroupSnapshotsTest-487592209 None] Update group completed successfully. Feb 27 02:03:36 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a9c86a7-a482-4e29-a121-21805e5d6e87 1073741824" returned: 0 in 0.608s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a9c86a7-a482-4e29-a121-21805e5d6e87 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:36 devstack sudo[85877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a9c86a7-a482-4e29-a121-21805e5d6e87 Feb 27 02:03:36 devstack sudo[85877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:37 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-b9acebf5-f62e-443d-8919-fb04647cd261 tempest-GroupSnapshotsTest-487592209 None] Update group completed successfully. Feb 27 02:03:37 devstack sudo[85877]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a9c86a7-a482-4e29-a121-21805e5d6e87" returned: 0 in 0.679s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:37 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:37 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff28bff-d377-4262-a9ed-dc2bf0e5e30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a9c86a7-a482-4e29-a121-21805e5d6e87', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:37 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c1ac85-6927-4916-afa6-f4d9485038d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:37 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Volume volume-7a9c86a7-a482-4e29-a121-21805e5d6e87 (7a9c86a7-a482-4e29-a121-21805e5d6e87): created successfully Feb 27 02:03:37 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c1ac85-6927-4916-afa6-f4d9485038d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:37 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Flow 'volume_create_manager' (d2ef5f08-51c9-44f4-81c8-69911b7f732f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:37 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-5366d96b-fb6c-4bb4-ba1e-5fbb13085f4f tempest-VolumesTransfersV355Test-1643455606 None] Created volume successfully. Feb 27 02:03:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9fe4b2a6-8313-4699-af7e-82410c475c2b tempest-VolumesTransfersV355Test-1874574990 None] Acquiring lock "cinder-7a9c86a7-a482-4e29-a121-21805e5d6e87-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9fe4b2a6-8313-4699-af7e-82410c475c2b tempest-VolumesTransfersV355Test-1874574990 None] Lock "cinder-7a9c86a7-a482-4e29-a121-21805e5d6e87-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9fe4b2a6-8313-4699-af7e-82410c475c2b tempest-VolumesTransfersV355Test-1874574990 None] Acquiring lock "cinder-quobyte-7a9c86a7-a482-4e29-a121-21805e5d6e87" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9fe4b2a6-8313-4699-af7e-82410c475c2b tempest-VolumesTransfersV355Test-1874574990 None] Lock "cinder-quobyte-7a9c86a7-a482-4e29-a121-21805e5d6e87" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:38 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba742b3-dd9f-4dcb-ba25-34d98f39fb7d]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:38 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-05ebf79c-2aa8-4c5e-8990-45fdc106e110 tempest-GroupSnapshotsTest-487592209 None] Update group completed successfully. Feb 27 02:03:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9fe4b2a6-8313-4699-af7e-82410c475c2b tempest-VolumesTransfersV355Test-1874574990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a9c86a7-a482-4e29-a121-21805e5d6e87 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:38 devstack sudo[85907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a9c86a7-a482-4e29-a121-21805e5d6e87 Feb 27 02:03:38 devstack sudo[85907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:39 devstack sudo[85907]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9fe4b2a6-8313-4699-af7e-82410c475c2b tempest-VolumesTransfersV355Test-1874574990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a9c86a7-a482-4e29-a121-21805e5d6e87" returned: 0 in 0.648s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9fe4b2a6-8313-4699-af7e-82410c475c2b tempest-VolumesTransfersV355Test-1874574990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a9c86a7-a482-4e29-a121-21805e5d6e87 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:39 devstack sudo[85913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a9c86a7-a482-4e29-a121-21805e5d6e87 Feb 27 02:03:39 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:39 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-2209ef41-7963-487e-8cec-224e91e819b1 tempest-GroupSnapshotsTest-487592209 None] Update group completed successfully. Feb 27 02:03:39 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9fe4b2a6-8313-4699-af7e-82410c475c2b tempest-VolumesTransfersV355Test-1874574990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a9c86a7-a482-4e29-a121-21805e5d6e87" returned: 0 in 0.593s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:40 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9fe4b2a6-8313-4699-af7e-82410c475c2b tempest-VolumesTransfersV355Test-1874574990 None] Lock "cinder-quobyte-7a9c86a7-a482-4e29-a121-21805e5d6e87" released by "delete_volume" :: held 1.267s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:40 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-9fe4b2a6-8313-4699-af7e-82410c475c2b tempest-VolumesTransfersV355Test-1874574990 None] Created reservations ['fd5c7595-13e6-42ea-8dac-e87d6104eb50', '07e73b0d-93ee-49b8-8bd8-cbb5c34413bc', 'f9b6d46e-c71a-4974-97d0-f3cb5542df28', '3bb65002-6af5-495d-a52d-980627c35a17'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9fe4b2a6-8313-4699-af7e-82410c475c2b tempest-VolumesTransfersV355Test-1874574990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9fe4b2a6-8313-4699-af7e-82410c475c2b tempest-VolumesTransfersV355Test-1874574990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:40 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-9fe4b2a6-8313-4699-af7e-82410c475c2b tempest-VolumesTransfersV355Test-1874574990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:40 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-9fe4b2a6-8313-4699-af7e-82410c475c2b tempest-VolumesTransfersV355Test-1874574990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9fe4b2a6-8313-4699-af7e-82410c475c2b tempest-VolumesTransfersV355Test-1874574990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9fe4b2a6-8313-4699-af7e-82410c475c2b tempest-VolumesTransfersV355Test-1874574990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:40 devstack sudo[85919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:03:40 devstack sudo[85919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:40 devstack sudo[85919]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9fe4b2a6-8313-4699-af7e-82410c475c2b tempest-VolumesTransfersV355Test-1874574990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.488s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:40 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-9fe4b2a6-8313-4699-af7e-82410c475c2b tempest-VolumesTransfersV355Test-1874574990 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:40 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-9fe4b2a6-8313-4699-af7e-82410c475c2b tempest-VolumesTransfersV355Test-1874574990 None] Deleted volume successfully. Feb 27 02:03:40 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9fe4b2a6-8313-4699-af7e-82410c475c2b tempest-VolumesTransfersV355Test-1874574990 None] Lock "cinder-7a9c86a7-a482-4e29-a121-21805e5d6e87-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:41 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] GroupSnapshot 31f3be3e-b308-435a-bc2e-96c815c61920: creating. Feb 27 02:03:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] Group snapshot 31f3be3e-b308-435a-bc2e-96c815c61920: creating. {{(pid=82683) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 02:03:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:41 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] Creating offline snapshot 30fdce04-0521-4dc1-a4d8-eee226d2b7a0 of volume c3ab7d79-b804-4dd2-8309-13869bb165f4 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:03:41 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f7b198-e947-4744-9a77-6c16afd29fac]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:41 devstack sudo[85922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4 Feb 27 02:03:41 devstack sudo[85922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:41 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Flow 'volume_create_manager' (f30e3d07-2364-45d3-a746-9a2053ba8281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aaa1425-2d7e-46dc-9d50-490de068645c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aaa1425-2d7e-46dc-9d50-490de068645c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-349995152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f36fc6-1f6e-46fa-90bd-519b2f1f1f26,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2f3b2c351b22473789830982bca36b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:41Z,use_quota=True,user_id='529b07ce8ca645859b67cad4e82613e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3203315-9818-453f-afbc-f42752766784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3203315-9818-453f-afbc-f42752766784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162f329f-6fe5-408a-af30-6b8c11c08da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162f329f-6fe5-408a-af30-6b8c11c08da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15f36fc6-1f6e-46fa-90bd-519b2f1f1f26', 'volume_name': 'volume-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d8882f-f835-4cef-bd61-54fc06adf8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d8882f-f835-4cef-bd61-54fc06adf8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73992e5-afce-414e-9524-8b38bbfe564f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:41 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Volume 15f36fc6-1f6e-46fa-90bd-519b2f1f1f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26', 'volume_size': 1} Feb 27 02:03:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:41 devstack sudo[85922]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4" returned: 0 in 0.585s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.30fdce04-0521-4dc1-a4d8-eee226d2b7a0 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:41 devstack sudo[85927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.30fdce04-0521-4dc1-a4d8-eee226d2b7a0 1G Feb 27 02:03:42 devstack sudo[85927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:42 devstack sudo[85927]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.30fdce04-0521-4dc1-a4d8-eee226d2b7a0 1G" returned: 0 in 0.686s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3ab7d79-b804-4dd2-8309-13869bb165f4 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.30fdce04-0521-4dc1-a4d8-eee226d2b7a0 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:42 devstack sudo[85932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3ab7d79-b804-4dd2-8309-13869bb165f4 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.30fdce04-0521-4dc1-a4d8-eee226d2b7a0 Feb 27 02:03:42 devstack sudo[85932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:43 devstack sudo[85932]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3ab7d79-b804-4dd2-8309-13869bb165f4 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.30fdce04-0521-4dc1-a4d8-eee226d2b7a0" returned: 0 in 0.530s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:43 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.30fdce04-0521-4dc1-a4d8-eee226d2b7a0 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:03:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.30fdce04-0521-4dc1-a4d8-eee226d2b7a0 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:43 devstack sudo[85937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.30fdce04-0521-4dc1-a4d8-eee226d2b7a0 Feb 27 02:03:43 devstack sudo[85937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:43 devstack sudo[85937]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.30fdce04-0521-4dc1-a4d8-eee226d2b7a0" returned: 0 in 0.496s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:43 devstack sudo[85940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.info Feb 27 02:03:43 devstack sudo[85940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:44 devstack sudo[85940]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.info" returned: 0 in 0.512s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:44 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:03:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:44 devstack sudo[85943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.info Feb 27 02:03:44 devstack sudo[85943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:44 devstack sudo[85943]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.info" returned: 0 in 0.494s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.396s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:44 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] Creating offline snapshot 633afa47-5302-4441-9fbb-637da53df9cf of volume 7a214615-9b11-43cf-a84a-b61a7a17cef7 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:03:44 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2c7d62-c356-405c-908d-b3786cfd381e]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:44 devstack sudo[85946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7 Feb 27 02:03:44 devstack sudo[85946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:45 devstack sudo[85946]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7" returned: 0 in 0.579s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.633afa47-5302-4441-9fbb-637da53df9cf 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:45 devstack sudo[85951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.633afa47-5302-4441-9fbb-637da53df9cf 1G Feb 27 02:03:45 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:46 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.633afa47-5302-4441-9fbb-637da53df9cf 1G" returned: 0 in 0.673s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a214615-9b11-43cf-a84a-b61a7a17cef7 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.633afa47-5302-4441-9fbb-637da53df9cf {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:46 devstack sudo[85957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a214615-9b11-43cf-a84a-b61a7a17cef7 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.633afa47-5302-4441-9fbb-637da53df9cf Feb 27 02:03:46 devstack sudo[85957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:46 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:46 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Flow 'volume_create_manager' (3b33c50f-316e-4d30-9823-4775c49d564a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:46 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3709cb-2650-464f-9dc9-ac65c06140cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:46 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3709cb-2650-464f-9dc9-ac65c06140cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-292420603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5020dd2e-e578-4994-a829-8af484790a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184a1bb13bab48ba827c912493ade4ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:46Z,use_quota=True,user_id='999a29bbe17e4e2097f0c5b1ffb0d282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:46 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00881b76-421e-4a2e-8541-394bc45e8d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:46 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00881b76-421e-4a2e-8541-394bc45e8d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:46 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57fba34a-5127-4d81-83c4-a76d7d99ae99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:46 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57fba34a-5127-4d81-83c4-a76d7d99ae99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5020dd2e-e578-4994-a829-8af484790a5d', 'volume_name': 'volume-5020dd2e-e578-4994-a829-8af484790a5d', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:46 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0dde996-27e4-414f-85ff-a1f422af63ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:46 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0dde996-27e4-414f-85ff-a1f422af63ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:46 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeffd37a-5699-4ba6-aada-bd67e5bf0026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:46 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Volume 5020dd2e-e578-4994-a829-8af484790a5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5020dd2e-e578-4994-a829-8af484790a5d', 'volume_size': 1} Feb 27 02:03:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:46 devstack sudo[85957]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a214615-9b11-43cf-a84a-b61a7a17cef7 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.633afa47-5302-4441-9fbb-637da53df9cf" returned: 0 in 0.604s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:46 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.633afa47-5302-4441-9fbb-637da53df9cf is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:03:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.633afa47-5302-4441-9fbb-637da53df9cf {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:46 devstack sudo[85977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.633afa47-5302-4441-9fbb-637da53df9cf Feb 27 02:03:46 devstack sudo[85977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:47 devstack sudo[85977]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.633afa47-5302-4441-9fbb-637da53df9cf" returned: 0 in 0.496s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:47 devstack sudo[85980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.info Feb 27 02:03:47 devstack sudo[85980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:47 devstack sudo[85980]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.info" returned: 0 in 0.459s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:47 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:03:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:47 devstack sudo[85983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.info Feb 27 02:03:47 devstack sudo[85983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:48 devstack sudo[85983]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.info" returned: 0 in 0.478s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.388s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.509s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-349995152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f36fc6-1f6e-46fa-90bd-519b2f1f1f26,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2f3b2c351b22473789830982bca36b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:41Z,use_quota=True,user_id='529b07ce8ca645859b67cad4e82613e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Creating volume 15f36fc6-1f6e-46fa-90bd-519b2f1f1f26 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:48 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:48 devstack sudo[85987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26 1073741824 Feb 27 02:03:48 devstack sudo[85987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:48 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-3c58570a-4d3c-4b32-947a-7b47c7d38256 tempest-GroupSnapshotsTest-487592209 None] group_snapshot 31f3be3e-b308-435a-bc2e-96c815c61920: created successfully Feb 27 02:03:48 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] group_snapshot 31f3be3e-b308-435a-bc2e-96c815c61920: deleting Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] group_snapshot 31f3be3e-b308-435a-bc2e-96c815c61920: deleting {{(pid=82683) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "cinder-quobyte-c3ab7d79-b804-4dd2-8309-13869bb165f4" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-c3ab7d79-b804-4dd2-8309-13869bb165f4" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "cinder-quobyte-30fdce04-0521-4dc1-a4d8-eee226d2b7a0" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-30fdce04-0521-4dc1-a4d8-eee226d2b7a0" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Deleting offline snapshot 30fdce04-0521-4dc1-a4d8-eee226d2b7a0 of volume c3ab7d79-b804-4dd2-8309-13869bb165f4 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] snapshot_file for this snap is: volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.30fdce04-0521-4dc1-a4d8-eee226d2b7a0 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d758725f-a6ef-4644-8eae-cc7498847b8b]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.30fdce04-0521-4dc1-a4d8-eee226d2b7a0 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:48 devstack sudo[85987]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26 1073741824" returned: 0 in 0.688s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:48 devstack sudo[85993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26 Feb 27 02:03:48 devstack sudo[85993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:48 devstack sudo[85992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.30fdce04-0521-4dc1-a4d8-eee226d2b7a0 Feb 27 02:03:48 devstack sudo[85992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:49 devstack sudo[85993]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26" returned: 0 in 0.436s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.730s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-292420603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5020dd2e-e578-4994-a829-8af484790a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184a1bb13bab48ba827c912493ade4ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:46Z,use_quota=True,user_id='999a29bbe17e4e2097f0c5b1ffb0d282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Creating volume 5020dd2e-e578-4994-a829-8af484790a5d {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:49 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5020dd2e-e578-4994-a829-8af484790a5d 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73992e5-afce-414e-9524-8b38bbfe564f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:49 devstack sudo[86003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5020dd2e-e578-4994-a829-8af484790a5d 1073741824 Feb 27 02:03:49 devstack sudo[86003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8c9141-65db-4510-be1b-578a8eb0723e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:49 devstack sudo[85992]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:49 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Volume volume-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26 (15f36fc6-1f6e-46fa-90bd-519b2f1f1f26): created successfully Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8c9141-65db-4510-be1b-578a8eb0723e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Flow 'volume_create_manager' (f30e3d07-2364-45d3-a746-9a2053ba8281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.30fdce04-0521-4dc1-a4d8-eee226d2b7a0" returned: 0 in 0.565s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3ab7d79-b804-4dd2-8309-13869bb165f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:49 devstack cinder-volume[82683]: INFO cinder.volume.manager [req-a03d0e88-f7de-47d9-aff5-e286cfd17f8f req-e50c87aa-9983-4e60-bf37-0c0f1b363f34 tempest-VolumesGetTestJSON-1990415521 None] Created volume successfully. Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c472f5-6f51-4eec-8951-eab2d61a1531]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:49 devstack sudo[86005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4 Feb 27 02:03:49 devstack sudo[86005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:49 devstack sudo[86003]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5020dd2e-e578-4994-a829-8af484790a5d 1073741824" returned: 0 in 0.566s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5020dd2e-e578-4994-a829-8af484790a5d {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:49 devstack sudo[86005]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:49 devstack sudo[86013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5020dd2e-e578-4994-a829-8af484790a5d Feb 27 02:03:49 devstack sudo[86013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4" returned: 0 in 0.556s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.30fdce04-0521-4dc1-a4d8-eee226d2b7a0 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:49 devstack sudo[86015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.30fdce04-0521-4dc1-a4d8-eee226d2b7a0 Feb 27 02:03:49 devstack sudo[86015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-9af7fe46-4403-45af-998e-7ca32d4780b0 req-ff2e6618-2c4f-4154-9c85-f5cf9995fb74 tempest-VolumesGetTestJSON-1990415521 None] Acquiring lock "cinder-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-9af7fe46-4403-45af-998e-7ca32d4780b0 req-ff2e6618-2c4f-4154-9c85-f5cf9995fb74 tempest-VolumesGetTestJSON-1990415521 None] Lock "cinder-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-9af7fe46-4403-45af-998e-7ca32d4780b0 req-ff2e6618-2c4f-4154-9c85-f5cf9995fb74 tempest-VolumesGetTestJSON-1990415521 None] Acquiring lock "cinder-quobyte-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-9af7fe46-4403-45af-998e-7ca32d4780b0 req-ff2e6618-2c4f-4154-9c85-f5cf9995fb74 tempest-VolumesGetTestJSON-1990415521 None] Lock "cinder-quobyte-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:50 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfa27b7-20ed-479a-94ff-e04330c7a4bc]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-9af7fe46-4403-45af-998e-7ca32d4780b0 req-ff2e6618-2c4f-4154-9c85-f5cf9995fb74 tempest-VolumesGetTestJSON-1990415521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:50 devstack sudo[86018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26 Feb 27 02:03:50 devstack sudo[86018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:50 devstack sudo[86013]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5020dd2e-e578-4994-a829-8af484790a5d" returned: 0 in 0.562s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:50 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeffd37a-5699-4ba6-aada-bd67e5bf0026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5020dd2e-e578-4994-a829-8af484790a5d', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4852762-8e45-482b-8cf3-b7e5f212ae64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:50 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Volume volume-5020dd2e-e578-4994-a829-8af484790a5d (5020dd2e-e578-4994-a829-8af484790a5d): created successfully Feb 27 02:03:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4852762-8e45-482b-8cf3-b7e5f212ae64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Flow 'volume_create_manager' (3b33c50f-316e-4d30-9823-4775c49d564a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:50 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-b6c673c2-79aa-4635-b5e5-33c266091e01 tempest-VolumesTransfersV357Test-1861005206 None] Created volume successfully. Feb 27 02:03:50 devstack sudo[86015]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.30fdce04-0521-4dc1-a4d8-eee226d2b7a0" returned: 0 in 0.619s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.30fdce04-0521-4dc1-a4d8-eee226d2b7a0 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:50 devstack sudo[86023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.30fdce04-0521-4dc1-a4d8-eee226d2b7a0 Feb 27 02:03:50 devstack sudo[86023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:51 devstack sudo[86018]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-9af7fe46-4403-45af-998e-7ca32d4780b0 req-ff2e6618-2c4f-4154-9c85-f5cf9995fb74 tempest-VolumesGetTestJSON-1990415521 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26" returned: 0 in 0.797s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-9af7fe46-4403-45af-998e-7ca32d4780b0 req-ff2e6618-2c4f-4154-9c85-f5cf9995fb74 tempest-VolumesGetTestJSON-1990415521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:51 devstack sudo[86055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26 Feb 27 02:03:51 devstack sudo[86055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:51 devstack sudo[86023]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4.30fdce04-0521-4dc1-a4d8-eee226d2b7a0" returned: 0 in 0.666s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-30fdce04-0521-4dc1-a4d8-eee226d2b7a0" released by "_delete_snapshot" :: held 2.482s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-c3ab7d79-b804-4dd2-8309-13869bb165f4" released by "delete_snapshot" :: held 2.496s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "cinder-quobyte-7a214615-9b11-43cf-a84a-b61a7a17cef7" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-7a214615-9b11-43cf-a84a-b61a7a17cef7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "cinder-quobyte-633afa47-5302-4441-9fbb-637da53df9cf" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-633afa47-5302-4441-9fbb-637da53df9cf" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Deleting offline snapshot 633afa47-5302-4441-9fbb-637da53df9cf of volume 7a214615-9b11-43cf-a84a-b61a7a17cef7 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] snapshot_file for this snap is: volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.633afa47-5302-4441-9fbb-637da53df9cf {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[665be5f8-1667-4c0f-be06-0c601b59c146]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.633afa47-5302-4441-9fbb-637da53df9cf {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:51 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-76bfc28a-4100-4e48-aec3-cb038fd39c29 tempest-VolumesTransfersV357Test-666125535 None] Transfer volume completed successfully. Feb 27 02:03:51 devstack sudo[86057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.633afa47-5302-4441-9fbb-637da53df9cf Feb 27 02:03:51 devstack sudo[86057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:51 devstack sudo[86055]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-9af7fe46-4403-45af-998e-7ca32d4780b0 req-ff2e6618-2c4f-4154-9c85-f5cf9995fb74 tempest-VolumesGetTestJSON-1990415521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26" returned: 0 in 0.625s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-9af7fe46-4403-45af-998e-7ca32d4780b0 req-ff2e6618-2c4f-4154-9c85-f5cf9995fb74 tempest-VolumesGetTestJSON-1990415521 None] Lock "cinder-quobyte-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26" released by "delete_volume" :: held 1.450s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG cinder.quota [req-9af7fe46-4403-45af-998e-7ca32d4780b0 req-ff2e6618-2c4f-4154-9c85-f5cf9995fb74 tempest-VolumesGetTestJSON-1990415521 None] Created reservations ['732f9961-7ec9-457f-a7cb-bb2322343866', '2ae575fa-5772-49a3-a178-5276aeebadcc', '5a074353-fe7b-44c9-a628-7fe97059e140', '3d1a6f1d-391e-4db1-a182-aa52c1784698'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-9af7fe46-4403-45af-998e-7ca32d4780b0 req-ff2e6618-2c4f-4154-9c85-f5cf9995fb74 tempest-VolumesGetTestJSON-1990415521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-9af7fe46-4403-45af-998e-7ca32d4780b0 req-ff2e6618-2c4f-4154-9c85-f5cf9995fb74 tempest-VolumesGetTestJSON-1990415521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-9af7fe46-4403-45af-998e-7ca32d4780b0 req-ff2e6618-2c4f-4154-9c85-f5cf9995fb74 tempest-VolumesGetTestJSON-1990415521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-9af7fe46-4403-45af-998e-7ca32d4780b0 req-ff2e6618-2c4f-4154-9c85-f5cf9995fb74 tempest-VolumesGetTestJSON-1990415521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-9af7fe46-4403-45af-998e-7ca32d4780b0 req-ff2e6618-2c4f-4154-9c85-f5cf9995fb74 tempest-VolumesGetTestJSON-1990415521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-9af7fe46-4403-45af-998e-7ca32d4780b0 req-ff2e6618-2c4f-4154-9c85-f5cf9995fb74 tempest-VolumesGetTestJSON-1990415521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:51 devstack sudo[86061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:03:51 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:52 devstack sudo[86057]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.633afa47-5302-4441-9fbb-637da53df9cf" returned: 0 in 0.710s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:52 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a214615-9b11-43cf-a84a-b61a7a17cef7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:03:52 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d582c24e-ef8b-4ac8-b71d-c2ea395cbcec]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:52 devstack sudo[86066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7 Feb 27 02:03:52 devstack sudo[86066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-578522bb-bfe6-4d8b-9a3f-b0b4bf449d3c tempest-VolumesTransfersV357Test-1835162353 None] Acquiring lock "cinder-5020dd2e-e578-4994-a829-8af484790a5d-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-578522bb-bfe6-4d8b-9a3f-b0b4bf449d3c tempest-VolumesTransfersV357Test-1835162353 None] Lock "cinder-5020dd2e-e578-4994-a829-8af484790a5d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-578522bb-bfe6-4d8b-9a3f-b0b4bf449d3c tempest-VolumesTransfersV357Test-1835162353 None] Acquiring lock "cinder-quobyte-5020dd2e-e578-4994-a829-8af484790a5d" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-578522bb-bfe6-4d8b-9a3f-b0b4bf449d3c tempest-VolumesTransfersV357Test-1835162353 None] Lock "cinder-quobyte-5020dd2e-e578-4994-a829-8af484790a5d" acquired by "delete_volume" :: waited 0.016s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:52 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-9af7fe46-4403-45af-998e-7ca32d4780b0 req-ff2e6618-2c4f-4154-9c85-f5cf9995fb74 tempest-VolumesGetTestJSON-1990415521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.632s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:52 devstack cinder-volume[82683]: DEBUG cinder.manager [req-9af7fe46-4403-45af-998e-7ca32d4780b0 req-ff2e6618-2c4f-4154-9c85-f5cf9995fb74 tempest-VolumesGetTestJSON-1990415521 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:52 devstack cinder-volume[82683]: INFO cinder.volume.manager [req-9af7fe46-4403-45af-998e-7ca32d4780b0 req-ff2e6618-2c4f-4154-9c85-f5cf9995fb74 tempest-VolumesGetTestJSON-1990415521 None] Deleted volume successfully. Feb 27 02:03:52 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[453bf5b7-b941-431b-a3a7-57009976d659]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-578522bb-bfe6-4d8b-9a3f-b0b4bf449d3c tempest-VolumesTransfersV357Test-1835162353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5020dd2e-e578-4994-a829-8af484790a5d {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-9af7fe46-4403-45af-998e-7ca32d4780b0 req-ff2e6618-2c4f-4154-9c85-f5cf9995fb74 tempest-VolumesGetTestJSON-1990415521 None] Lock "cinder-15f36fc6-1f6e-46fa-90bd-519b2f1f1f26-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:52 devstack sudo[86069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5020dd2e-e578-4994-a829-8af484790a5d Feb 27 02:03:52 devstack sudo[86069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:52 devstack sudo[86066]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7" returned: 0 in 0.761s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.633afa47-5302-4441-9fbb-637da53df9cf {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:52 devstack sudo[86074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.633afa47-5302-4441-9fbb-637da53df9cf Feb 27 02:03:52 devstack sudo[86074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:53 devstack sudo[86069]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-578522bb-bfe6-4d8b-9a3f-b0b4bf449d3c tempest-VolumesTransfersV357Test-1835162353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5020dd2e-e578-4994-a829-8af484790a5d" returned: 0 in 0.753s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-578522bb-bfe6-4d8b-9a3f-b0b4bf449d3c tempest-VolumesTransfersV357Test-1835162353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5020dd2e-e578-4994-a829-8af484790a5d {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:53 devstack sudo[86079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5020dd2e-e578-4994-a829-8af484790a5d Feb 27 02:03:53 devstack sudo[86079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:53 devstack sudo[86074]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.633afa47-5302-4441-9fbb-637da53df9cf" returned: 0 in 0.928s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.633afa47-5302-4441-9fbb-637da53df9cf {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:53 devstack sudo[86084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.633afa47-5302-4441-9fbb-637da53df9cf Feb 27 02:03:53 devstack sudo[86084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:54 devstack sudo[86079]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-578522bb-bfe6-4d8b-9a3f-b0b4bf449d3c tempest-VolumesTransfersV357Test-1835162353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5020dd2e-e578-4994-a829-8af484790a5d" returned: 0 in 0.765s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:54 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-578522bb-bfe6-4d8b-9a3f-b0b4bf449d3c tempest-VolumesTransfersV357Test-1835162353 None] Lock "cinder-quobyte-5020dd2e-e578-4994-a829-8af484790a5d" released by "delete_volume" :: held 1.570s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:54 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-578522bb-bfe6-4d8b-9a3f-b0b4bf449d3c tempest-VolumesTransfersV357Test-1835162353 None] Created reservations ['93865ef9-2fa3-4d36-a848-1b1491ea2719', '0e15b372-deaa-4429-9672-19bbe15f739b', 'bb9d9740-d0bc-4286-a19f-1e30cbf31791', '25bfc566-9a1a-470d-9f7a-2f8fa8aa68d3'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-578522bb-bfe6-4d8b-9a3f-b0b4bf449d3c tempest-VolumesTransfersV357Test-1835162353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-578522bb-bfe6-4d8b-9a3f-b0b4bf449d3c tempest-VolumesTransfersV357Test-1835162353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:54 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-578522bb-bfe6-4d8b-9a3f-b0b4bf449d3c tempest-VolumesTransfersV357Test-1835162353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:54 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-578522bb-bfe6-4d8b-9a3f-b0b4bf449d3c tempest-VolumesTransfersV357Test-1835162353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-578522bb-bfe6-4d8b-9a3f-b0b4bf449d3c tempest-VolumesTransfersV357Test-1835162353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-578522bb-bfe6-4d8b-9a3f-b0b4bf449d3c tempest-VolumesTransfersV357Test-1835162353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:54 devstack sudo[86087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:03:54 devstack sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:54 devstack sudo[86084]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7.633afa47-5302-4441-9fbb-637da53df9cf" returned: 0 in 0.870s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:54 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-633afa47-5302-4441-9fbb-637da53df9cf" released by "_delete_snapshot" :: held 3.384s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:54 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-7a214615-9b11-43cf-a84a-b61a7a17cef7" released by "delete_snapshot" :: held 3.421s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:54 devstack cinder-volume[82683]: WARNING cinder.quota [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-566081724 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-566081724, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:03:54 devstack cinder-volume[82683]: WARNING cinder.quota [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-566081724 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-566081724, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:03:54 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Created reservations ['b7d1387d-df6b-4df8-a54d-bc0da038e4b7', '28923a3b-a2c6-4307-9f7b-7183d6c053ba', '82180c92-06a8-4726-bb7b-511d263dd898', '4b4b2438-30f0-44f0-a054-af75e6621cbb'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:54 devstack sudo[86087]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-578522bb-bfe6-4d8b-9a3f-b0b4bf449d3c tempest-VolumesTransfersV357Test-1835162353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.802s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:54 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-578522bb-bfe6-4d8b-9a3f-b0b4bf449d3c tempest-VolumesTransfersV357Test-1835162353 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:03:55 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-578522bb-bfe6-4d8b-9a3f-b0b4bf449d3c tempest-VolumesTransfersV357Test-1835162353 None] Deleted volume successfully. Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-578522bb-bfe6-4d8b-9a3f-b0b4bf449d3c tempest-VolumesTransfersV357Test-1835162353 None] Lock "cinder-5020dd2e-e578-4994-a829-8af484790a5d-delete_volume" released by "delete_volume" :: held 2.637s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] Created reservations ['6fc58f2c-1e64-463e-a279-874ff37ba8ad', '5e7fdad5-e0a4-4cd2-8689-21db10ace28a', '5e2a5944-8cea-4ca0-a4f9-49b6953b10fb', '65e69cc9-15b3-481f-a7cf-cb1ff13e100f'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:55 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-5450b03e-7176-4f97-8f77-aa447e6e4924 tempest-GroupSnapshotsTest-487592209 None] group_snapshot 31f3be3e-b308-435a-bc2e-96c815c61920: deleted successfully Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Flow 'volume_create_manager' (b964d9ac-3dc5-4d04-a793-9b56a064efe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e35f1a2-c373-4a79-9c3c-f3f90b849745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e35f1a2-c373-4a79-9c3c-f3f90b849745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-589277617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9af5c85-fde2-4333-b15d-6e01bac36c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184a1bb13bab48ba827c912493ade4ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:55Z,use_quota=True,user_id='999a29bbe17e4e2097f0c5b1ffb0d282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc85aaa9-6425-4733-bf4e-0746e7bb3ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc85aaa9-6425-4733-bf4e-0746e7bb3ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2276711-e644-4bd9-8607-0f2f67182f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2276711-e644-4bd9-8607-0f2f67182f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9af5c85-fde2-4333-b15d-6e01bac36c86', 'volume_name': 'volume-a9af5c85-fde2-4333-b15d-6e01bac36c86', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172443f0-591f-4677-bf95-2f8586c791d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172443f0-591f-4677-bf95-2f8586c791d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9213c19f-ac8a-4ca3-881d-d36e638ae9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:55 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Volume a9af5c85-fde2-4333-b15d-6e01bac36c86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9af5c85-fde2-4333-b15d-6e01bac36c86', 'volume_size': 1} Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-589277617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9af5c85-fde2-4333-b15d-6e01bac36c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184a1bb13bab48ba827c912493ade4ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:55Z,use_quota=True,user_id='999a29bbe17e4e2097f0c5b1ffb0d282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Creating volume a9af5c85-fde2-4333-b15d-6e01bac36c86 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:55 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a9af5c85-fde2-4333-b15d-6e01bac36c86 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:55 devstack sudo[86091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a9af5c85-fde2-4333-b15d-6e01bac36c86 1073741824 Feb 27 02:03:55 devstack sudo[86091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:55 devstack sudo[86091]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a9af5c85-fde2-4333-b15d-6e01bac36c86 1073741824" returned: 0 in 0.702s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a9af5c85-fde2-4333-b15d-6e01bac36c86 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:56 devstack sudo[86096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a9af5c85-fde2-4333-b15d-6e01bac36c86 Feb 27 02:03:56 devstack sudo[86096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Flow 'volume_create_manager' (e69963da-55d9-4ff3-b975-859ca0f85bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0aea30c-15ae-4342-a814-8bae4d4741cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0aea30c-15ae-4342-a814-8bae4d4741cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2002408235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c8512c-eb87-4b48-8bbe-bfd7835fef6e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4a1d69761a264cef9f844170d4e20af5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:56Z,use_quota=True,user_id='ba6b9c7e78194a3baa69ee528fce576b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72980720-4269-45b3-b6db-490853938289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72980720-4269-45b3-b6db-490853938289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17501d58-8050-4f73-93cb-c78396a1beda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17501d58-8050-4f73-93cb-c78396a1beda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10c8512c-eb87-4b48-8bbe-bfd7835fef6e', 'volume_name': 'volume-10c8512c-eb87-4b48-8bbe-bfd7835fef6e', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ef14a8-ad3b-4221-8b92-3c1d251bc0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ef14a8-ad3b-4221-8b92-3c1d251bc0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597269c1-b903-4590-a81d-73de1468e405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:56 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Volume 10c8512c-eb87-4b48-8bbe-bfd7835fef6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10c8512c-eb87-4b48-8bbe-bfd7835fef6e', 'volume_size': 1} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "cinder-quobyte-7a214615-9b11-43cf-a84a-b61a7a17cef7" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-7a214615-9b11-43cf-a84a-b61a7a17cef7" acquired by "delete_volume" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2db557-5edf-4962-be53-776cf040ca6f]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:56 devstack sudo[86096]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a9af5c85-fde2-4333-b15d-6e01bac36c86" returned: 0 in 0.543s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.340s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2002408235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c8512c-eb87-4b48-8bbe-bfd7835fef6e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4a1d69761a264cef9f844170d4e20af5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:56Z,use_quota=True,user_id='ba6b9c7e78194a3baa69ee528fce576b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Creating volume 10c8512c-eb87-4b48-8bbe-bfd7835fef6e {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:56 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-10c8512c-eb87-4b48-8bbe-bfd7835fef6e 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:56 devstack sudo[86100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-10c8512c-eb87-4b48-8bbe-bfd7835fef6e 1073741824 Feb 27 02:03:56 devstack sudo[86100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:56 devstack sudo[86099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7 Feb 27 02:03:56 devstack sudo[86099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9213c19f-ac8a-4ca3-881d-d36e638ae9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9af5c85-fde2-4333-b15d-6e01bac36c86', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b15692-cb57-4aa1-b7b9-c205eda4fc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:56 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Volume volume-a9af5c85-fde2-4333-b15d-6e01bac36c86 (a9af5c85-fde2-4333-b15d-6e01bac36c86): created successfully Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b15692-cb57-4aa1-b7b9-c205eda4fc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Flow 'volume_create_manager' (b964d9ac-3dc5-4d04-a793-9b56a064efe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:56 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-e628796f-f527-4383-82db-e5dfb98a9248 tempest-VolumesTransfersV357Test-1861005206 None] Created volume successfully. Feb 27 02:03:57 devstack sudo[86099]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7" returned: 0 in 0.576s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:57 devstack sudo[86109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7 Feb 27 02:03:57 devstack sudo[86109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:57 devstack sudo[86100]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-10c8512c-eb87-4b48-8bbe-bfd7835fef6e 1073741824" returned: 0 in 0.595s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-10c8512c-eb87-4b48-8bbe-bfd7835fef6e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:57 devstack sudo[86111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-10c8512c-eb87-4b48-8bbe-bfd7835fef6e Feb 27 02:03:57 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:57 devstack sudo[86109]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7a214615-9b11-43cf-a84a-b61a7a17cef7" returned: 0 in 0.480s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-7a214615-9b11-43cf-a84a-b61a7a17cef7" released by "delete_volume" :: held 1.102s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "cinder-quobyte-c3ab7d79-b804-4dd2-8309-13869bb165f4" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-c3ab7d79-b804-4dd2-8309-13869bb165f4" acquired by "delete_volume" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c02338d-c944-4a61-8ea0-a9c6a2e05b9e]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b06db2b8-55d7-4f29-b9d6-8433173f6042 tempest-VolumesTransfersV357Test-1835162353 None] Acquiring lock "cinder-a9af5c85-fde2-4333-b15d-6e01bac36c86-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b06db2b8-55d7-4f29-b9d6-8433173f6042 tempest-VolumesTransfersV357Test-1835162353 None] Lock "cinder-a9af5c85-fde2-4333-b15d-6e01bac36c86-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b06db2b8-55d7-4f29-b9d6-8433173f6042 tempest-VolumesTransfersV357Test-1835162353 None] Acquiring lock "cinder-quobyte-a9af5c85-fde2-4333-b15d-6e01bac36c86" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b06db2b8-55d7-4f29-b9d6-8433173f6042 tempest-VolumesTransfersV357Test-1835162353 None] Lock "cinder-quobyte-a9af5c85-fde2-4333-b15d-6e01bac36c86" acquired by "delete_volume" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8cb0df-95df-47ff-bbed-a99409366a52]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b06db2b8-55d7-4f29-b9d6-8433173f6042 tempest-VolumesTransfersV357Test-1835162353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a9af5c85-fde2-4333-b15d-6e01bac36c86 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:57 devstack sudo[86114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4 Feb 27 02:03:57 devstack sudo[86114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:57 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-10c8512c-eb87-4b48-8bbe-bfd7835fef6e" returned: 0 in 0.645s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597269c1-b903-4590-a81d-73de1468e405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10c8512c-eb87-4b48-8bbe-bfd7835fef6e', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed42745-e3df-4f6b-a0db-7e05606ef2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:57 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Volume volume-10c8512c-eb87-4b48-8bbe-bfd7835fef6e (10c8512c-eb87-4b48-8bbe-bfd7835fef6e): created successfully Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed42745-e3df-4f6b-a0db-7e05606ef2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:57 devstack sudo[86117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a9af5c85-fde2-4333-b15d-6e01bac36c86 Feb 27 02:03:57 devstack sudo[86117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Flow 'volume_create_manager' (e69963da-55d9-4ff3-b975-859ca0f85bdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:57 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-e70dc51e-4a19-4b80-9c23-8e7c7d56bd12 tempest-VolumesTestJSON-1295381596 None] Created volume successfully. Feb 27 02:03:58 devstack sudo[86114]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4" returned: 0 in 0.881s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:58 devstack sudo[86154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4 Feb 27 02:03:58 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:58 devstack sudo[86117]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b06db2b8-55d7-4f29-b9d6-8433173f6042 tempest-VolumesTransfersV357Test-1835162353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a9af5c85-fde2-4333-b15d-6e01bac36c86" returned: 0 in 0.844s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b06db2b8-55d7-4f29-b9d6-8433173f6042 tempest-VolumesTransfersV357Test-1835162353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a9af5c85-fde2-4333-b15d-6e01bac36c86 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:58 devstack sudo[86156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a9af5c85-fde2-4333-b15d-6e01bac36c86 Feb 27 02:03:58 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Flow 'volume_create_manager' (55cf117e-976b-413d-b732-1272159f33fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6a1385-9ad6-4d49-8a8a-237f2e75969e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6a1385-9ad6-4d49-8a8a-237f2e75969e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1399751130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e99acb-9b9b-40d0-b226-fd57ed22373f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4a1d69761a264cef9f844170d4e20af5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:59Z,use_quota=True,user_id='ba6b9c7e78194a3baa69ee528fce576b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79f2a151-363c-44eb-ab21-a4f63e523267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79f2a151-363c-44eb-ab21-a4f63e523267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745173bb-86cc-4306-a2f1-226210e299aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745173bb-86cc-4306-a2f1-226210e299aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47e99acb-9b9b-40d0-b226-fd57ed22373f', 'volume_name': 'volume-47e99acb-9b9b-40d0-b226-fd57ed22373f', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b95806b8-7602-4955-8b4c-d9b2beecd284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b95806b8-7602-4955-8b4c-d9b2beecd284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b32ac3e5-a5d0-4994-85e7-8bbfcbb7e980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:03:58 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Volume 47e99acb-9b9b-40d0-b226-fd57ed22373f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47e99acb-9b9b-40d0-b226-fd57ed22373f', 'volume_size': 1} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1399751130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e99acb-9b9b-40d0-b226-fd57ed22373f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4a1d69761a264cef9f844170d4e20af5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:03:59Z,use_quota=True,user_id='ba6b9c7e78194a3baa69ee528fce576b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Creating volume 47e99acb-9b9b-40d0-b226-fd57ed22373f {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:03:58 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:03:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-47e99acb-9b9b-40d0-b226-fd57ed22373f 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:58 devstack sudo[86158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-47e99acb-9b9b-40d0-b226-fd57ed22373f 1073741824 Feb 27 02:03:58 devstack sudo[86158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:59 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-c3ab7d79-b804-4dd2-8309-13869bb165f4" returned: 0 in 0.848s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-c3ab7d79-b804-4dd2-8309-13869bb165f4" released by "delete_volume" :: held 1.786s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:59 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b06db2b8-55d7-4f29-b9d6-8433173f6042 tempest-VolumesTransfersV357Test-1835162353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a9af5c85-fde2-4333-b15d-6e01bac36c86" returned: 0 in 0.862s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b06db2b8-55d7-4f29-b9d6-8433173f6042 tempest-VolumesTransfersV357Test-1835162353 None] Lock "cinder-quobyte-a9af5c85-fde2-4333-b15d-6e01bac36c86" released by "delete_volume" :: held 1.746s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Created reservations ['9eff0b85-f30f-49cc-a5b2-4a301d7c942c'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-b06db2b8-55d7-4f29-b9d6-8433173f6042 tempest-VolumesTransfersV357Test-1835162353 None] Created reservations ['14710651-a76c-4a51-a73b-fc8011a211e7', 'c83a13bf-de77-49f2-8cf5-1004aa2e3ca2', '94525be1-5893-4974-a8ed-757caf529b2e', 'acc53b2c-ba28-4c54-ba53-01e21e8b0baa'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:59 devstack cinder-volume[82683]: WARNING cinder.quota [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-566081724 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-566081724, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b06db2b8-55d7-4f29-b9d6-8433173f6042 tempest-VolumesTransfersV357Test-1835162353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b06db2b8-55d7-4f29-b9d6-8433173f6042 tempest-VolumesTransfersV357Test-1835162353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b06db2b8-55d7-4f29-b9d6-8433173f6042 tempest-VolumesTransfersV357Test-1835162353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b06db2b8-55d7-4f29-b9d6-8433173f6042 tempest-VolumesTransfersV357Test-1835162353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b06db2b8-55d7-4f29-b9d6-8433173f6042 tempest-VolumesTransfersV357Test-1835162353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b06db2b8-55d7-4f29-b9d6-8433173f6042 tempest-VolumesTransfersV357Test-1835162353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Created reservations ['7a9657be-1876-4ac0-950d-34b8fc3d1a01', '98b705c6-c46b-4a91-9c25-9a30bcc9fb1b', 'c96c535f-0a3d-4d6c-8fdf-74a6887d40ae', '2098caab-e8f2-440f-a5ee-faed354215ba'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:59 devstack sudo[86165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:03:59 devstack sudo[86165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Created reservations ['b8bc8bac-9c6d-4753-a569-867abcfbcdc1', '11df4897-5568-4452-b8ca-c6fe811611a0', '072a0cc2-88f8-41b0-8803-10c397cb3278', 'cf389afc-3df8-48c6-81dd-dd2f8c5b1433'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:03:59 devstack sudo[86158]: pam_unix(sudo:session): session closed for user root Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-47e99acb-9b9b-40d0-b226-fd57ed22373f 1073741824" returned: 0 in 0.931s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-47e99acb-9b9b-40d0-b226-fd57ed22373f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:03:59 devstack sudo[86168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-47e99acb-9b9b-40d0-b226-fd57ed22373f Feb 27 02:03:59 devstack sudo[86168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:00 devstack sudo[86167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:04:00 devstack sudo[86167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:00 devstack sudo[86165]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b06db2b8-55d7-4f29-b9d6-8433173f6042 tempest-VolumesTransfersV357Test-1835162353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.889s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:00 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-b06db2b8-55d7-4f29-b9d6-8433173f6042 tempest-VolumesTransfersV357Test-1835162353 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:00 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-b06db2b8-55d7-4f29-b9d6-8433173f6042 tempest-VolumesTransfersV357Test-1835162353 None] Deleted volume successfully. Feb 27 02:04:00 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b06db2b8-55d7-4f29-b9d6-8433173f6042 tempest-VolumesTransfersV357Test-1835162353 None] Lock "cinder-a9af5c85-fde2-4333-b15d-6e01bac36c86-delete_volume" released by "delete_volume" :: held 2.865s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:00 devstack sudo[86168]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-47e99acb-9b9b-40d0-b226-fd57ed22373f" returned: 0 in 0.696s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:00 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b32ac3e5-a5d0-4994-85e7-8bbfcbb7e980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47e99acb-9b9b-40d0-b226-fd57ed22373f', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:00 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48775aff-7ab8-4bdf-a0f6-bf300a7e8612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:00 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Volume volume-47e99acb-9b9b-40d0-b226-fd57ed22373f (47e99acb-9b9b-40d0-b226-fd57ed22373f): created successfully Feb 27 02:04:00 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48775aff-7ab8-4bdf-a0f6-bf300a7e8612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:00 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Flow 'volume_create_manager' (55cf117e-976b-413d-b732-1272159f33fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:00 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-94c69e83-466c-42c6-92f4-4c32dbf247f3 tempest-VolumesTestJSON-1295381596 None] Created volume successfully. Feb 27 02:04:00 devstack sudo[86167]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.807s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:00 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:00 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-ee97378c-b806-485c-aa0a-b3d14e1de9da tempest-GroupSnapshotsTest-487592209 None] Delete group completed successfully. Feb 27 02:04:01 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-66877bbe-2e59-483b-92a7-dbae9ff39a56 tempest-GroupSnapshotsTest-487592209 None] Group tempest-GroupSnapshotsTest-Group-1209219836: creating Feb 27 02:04:01 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-66877bbe-2e59-483b-92a7-dbae9ff39a56 tempest-GroupSnapshotsTest-487592209 None] Group tempest-GroupSnapshotsTest-Group-1209219836: created successfully Feb 27 02:04:01 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-66877bbe-2e59-483b-92a7-dbae9ff39a56 tempest-GroupSnapshotsTest-487592209 None] Create group completed successfully. Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Flow 'volume_create_manager' (b0b4a878-682a-4e01-a3d6-61c97453997f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b2b9c2-9425-4406-8330-2fdf5c90164a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b2b9c2-9425-4406-8330-2fdf5c90164a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-797583272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6859cce4-1224-4795-9d95-da6acd4c59ad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4a1d69761a264cef9f844170d4e20af5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:01Z,use_quota=True,user_id='ba6b9c7e78194a3baa69ee528fce576b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16064ee1-b352-4af5-a4b9-4a62838c9f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16064ee1-b352-4af5-a4b9-4a62838c9f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27adad32-83e3-4f30-b646-033d98479b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27adad32-83e3-4f30-b646-033d98479b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6859cce4-1224-4795-9d95-da6acd4c59ad', 'volume_name': 'volume-6859cce4-1224-4795-9d95-da6acd4c59ad', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3031c397-4cd6-46c8-bbaf-30a81b43a41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3031c397-4cd6-46c8-bbaf-30a81b43a41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b0f431-047e-4491-98f6-cf89a10b5192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:01 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Volume 6859cce4-1224-4795-9d95-da6acd4c59ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6859cce4-1224-4795-9d95-da6acd4c59ad', 'volume_size': 1} Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-797583272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6859cce4-1224-4795-9d95-da6acd4c59ad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4a1d69761a264cef9f844170d4e20af5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:01Z,use_quota=True,user_id='ba6b9c7e78194a3baa69ee528fce576b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Creating volume 6859cce4-1224-4795-9d95-da6acd4c59ad {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:01 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:04:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6859cce4-1224-4795-9d95-da6acd4c59ad 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:01 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6859cce4-1224-4795-9d95-da6acd4c59ad 1073741824 Feb 27 02:04:01 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:02 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6859cce4-1224-4795-9d95-da6acd4c59ad 1073741824" returned: 0 in 0.897s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6859cce4-1224-4795-9d95-da6acd4c59ad {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:02 devstack sudo[86179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6859cce4-1224-4795-9d95-da6acd4c59ad Feb 27 02:04:02 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:02 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Flow 'volume_create_manager' (03abf4bb-4905-4b5e-835d-ef7acfe80fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6742bf51-802f-4b5a-a072-e94e7afe5ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6742bf51-802f-4b5a-a072-e94e7afe5ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-294416658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eee80324-a1ec-4202-a866-239367d48195,host='devstack@QuobyteHD#QuobyteHD',id=9b2317f9-1434-4d85-b4a0-d55680e0862a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56d45f666c694f60955bdf68e51b9af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:03Z,use_quota=True,user_id='11c4672cca1b480a9438ee0fb1550fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(800ece5b-d949-4285-8b22-dea5011d1710),volume_type_id=800ece5b-d949-4285-8b22-dea5011d1710)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd913ef3-25a0-4185-92cf-0cf174c66d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd913ef3-25a0-4185-92cf-0cf174c66d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a28280-d500-4559-a610-5416df9a24a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a28280-d500-4559-a610-5416df9a24a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b2317f9-1434-4d85-b4a0-d55680e0862a', 'volume_name': 'volume-9b2317f9-1434-4d85-b4a0-d55680e0862a', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1134b01e-492a-4764-8fc1-55ba15dd3364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1134b01e-492a-4764-8fc1-55ba15dd3364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25f8331-466c-48a7-be64-67345a670561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:03 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Volume 9b2317f9-1434-4d85-b4a0-d55680e0862a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b2317f9-1434-4d85-b4a0-d55680e0862a', 'volume_size': 1} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:03 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6859cce4-1224-4795-9d95-da6acd4c59ad" returned: 0 in 0.834s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.263s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eee80324-a1ec-4202-a866-239367d48195,created_at=2026-02-27T01:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-294416658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eee80324-a1ec-4202-a866-239367d48195,host='devstack@QuobyteHD#QuobyteHD',id=9b2317f9-1434-4d85-b4a0-d55680e0862a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56d45f666c694f60955bdf68e51b9af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:03Z,use_quota=True,user_id='11c4672cca1b480a9438ee0fb1550fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(800ece5b-d949-4285-8b22-dea5011d1710),volume_type_id=800ece5b-d949-4285-8b22-dea5011d1710)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Creating volume 9b2317f9-1434-4d85-b4a0-d55680e0862a {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:03 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b0f431-047e-4491-98f6-cf89a10b5192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6859cce4-1224-4795-9d95-da6acd4c59ad', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8764a77d-cebc-4bdb-9103-35fa9248a068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:03 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Volume volume-6859cce4-1224-4795-9d95-da6acd4c59ad (6859cce4-1224-4795-9d95-da6acd4c59ad): created successfully Feb 27 02:04:03 devstack sudo[86201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a 1073741824 Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8764a77d-cebc-4bdb-9103-35fa9248a068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:03 devstack sudo[86201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Flow 'volume_create_manager' (b0b4a878-682a-4e01-a3d6-61c97453997f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:03 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-d6838554-9ad1-4650-8f10-72aa3033162d tempest-VolumesTestJSON-1295381596 None] Created volume successfully. Feb 27 02:04:04 devstack sudo[86201]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a 1073741824" returned: 0 in 1.100s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:04 devstack sudo[86207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a Feb 27 02:04:04 devstack sudo[86207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4c6edacc-1bac-4816-817f-f8bdc8258ea9 tempest-VolumesTestJSON-1295381596 None] Acquiring lock "cinder-6859cce4-1224-4795-9d95-da6acd4c59ad-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4c6edacc-1bac-4816-817f-f8bdc8258ea9 tempest-VolumesTestJSON-1295381596 None] Lock "cinder-6859cce4-1224-4795-9d95-da6acd4c59ad-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4c6edacc-1bac-4816-817f-f8bdc8258ea9 tempest-VolumesTestJSON-1295381596 None] Acquiring lock "cinder-quobyte-6859cce4-1224-4795-9d95-da6acd4c59ad" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4c6edacc-1bac-4816-817f-f8bdc8258ea9 tempest-VolumesTestJSON-1295381596 None] Lock "cinder-quobyte-6859cce4-1224-4795-9d95-da6acd4c59ad" acquired by "delete_volume" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:04 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[841596b3-74ce-4344-a8ab-0107163f595a]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4c6edacc-1bac-4816-817f-f8bdc8258ea9 tempest-VolumesTestJSON-1295381596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6859cce4-1224-4795-9d95-da6acd4c59ad {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:04 devstack sudo[86209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6859cce4-1224-4795-9d95-da6acd4c59ad Feb 27 02:04:04 devstack sudo[86209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:05 devstack sudo[86207]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a" returned: 0 in 0.842s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:05 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:05 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25f8331-466c-48a7-be64-67345a670561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b2317f9-1434-4d85-b4a0-d55680e0862a', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:05 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (346a4676-2925-4795-9d26-b03351d1d36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:05 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Volume volume-9b2317f9-1434-4d85-b4a0-d55680e0862a (9b2317f9-1434-4d85-b4a0-d55680e0862a): created successfully Feb 27 02:04:05 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (346a4676-2925-4795-9d26-b03351d1d36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:05 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Flow 'volume_create_manager' (03abf4bb-4905-4b5e-835d-ef7acfe80fb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:05 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-e4c33af4-b228-4b23-8c13-f0262cd86033 tempest-GroupSnapshotsTest-487592209 None] Created volume successfully. Feb 27 02:04:05 devstack sudo[86209]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4c6edacc-1bac-4816-817f-f8bdc8258ea9 tempest-VolumesTestJSON-1295381596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6859cce4-1224-4795-9d95-da6acd4c59ad" returned: 0 in 0.785s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4c6edacc-1bac-4816-817f-f8bdc8258ea9 tempest-VolumesTestJSON-1295381596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6859cce4-1224-4795-9d95-da6acd4c59ad {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:05 devstack sudo[86249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6859cce4-1224-4795-9d95-da6acd4c59ad Feb 27 02:04:05 devstack sudo[86249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:06 devstack sudo[86249]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4c6edacc-1bac-4816-817f-f8bdc8258ea9 tempest-VolumesTestJSON-1295381596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6859cce4-1224-4795-9d95-da6acd4c59ad" returned: 0 in 0.526s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4c6edacc-1bac-4816-817f-f8bdc8258ea9 tempest-VolumesTestJSON-1295381596 None] Lock "cinder-quobyte-6859cce4-1224-4795-9d95-da6acd4c59ad" released by "delete_volume" :: held 1.338s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:06 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-4c6edacc-1bac-4816-817f-f8bdc8258ea9 tempest-VolumesTestJSON-1295381596 None] Created reservations ['7b67035c-c87b-474a-8e71-2f3701d4be6e', '41dba3a1-0149-474c-b68c-5b20e0010921', '285c67b6-6971-4c73-9397-beabbd519935', '8cacbed4-692d-477c-8668-afce548d4694'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4c6edacc-1bac-4816-817f-f8bdc8258ea9 tempest-VolumesTestJSON-1295381596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4c6edacc-1bac-4816-817f-f8bdc8258ea9 tempest-VolumesTestJSON-1295381596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:06 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4c6edacc-1bac-4816-817f-f8bdc8258ea9 tempest-VolumesTestJSON-1295381596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:06 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4c6edacc-1bac-4816-817f-f8bdc8258ea9 tempest-VolumesTestJSON-1295381596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4c6edacc-1bac-4816-817f-f8bdc8258ea9 tempest-VolumesTestJSON-1295381596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4c6edacc-1bac-4816-817f-f8bdc8258ea9 tempest-VolumesTestJSON-1295381596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:06 devstack sudo[86252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:04:06 devstack sudo[86252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:06 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-34fcdce3-588c-4cff-b131-c99ac8b1bd15 tempest-GroupSnapshotsTest-487592209 None] GroupSnapshot ad30ef69-19de-4433-8bd1-d604d1000c9b: creating. Feb 27 02:04:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-34fcdce3-588c-4cff-b131-c99ac8b1bd15 tempest-GroupSnapshotsTest-487592209 None] Group snapshot ad30ef69-19de-4433-8bd1-d604d1000c9b: creating. {{(pid=82683) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 27 02:04:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-34fcdce3-588c-4cff-b131-c99ac8b1bd15 tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-34fcdce3-588c-4cff-b131-c99ac8b1bd15 tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:06 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-34fcdce3-588c-4cff-b131-c99ac8b1bd15 tempest-GroupSnapshotsTest-487592209 None] Creating offline snapshot 7c4f9287-713f-4a87-812f-848169b53368 of volume 9b2317f9-1434-4d85-b4a0-d55680e0862a {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:04:06 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df8184b-2746-4bfa-a040-2d61a958d5ec]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-34fcdce3-588c-4cff-b131-c99ac8b1bd15 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:06 devstack sudo[86254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a Feb 27 02:04:06 devstack sudo[86254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:06 devstack sudo[86252]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4c6edacc-1bac-4816-817f-f8bdc8258ea9 tempest-VolumesTestJSON-1295381596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.701s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:06 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-4c6edacc-1bac-4816-817f-f8bdc8258ea9 tempest-VolumesTestJSON-1295381596 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:06 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-4c6edacc-1bac-4816-817f-f8bdc8258ea9 tempest-VolumesTestJSON-1295381596 None] Deleted volume successfully. Feb 27 02:04:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a4df1443-9717-4f61-85be-2294127c42ac tempest-VolumesTestJSON-1295381596 None] Acquiring lock "cinder-47e99acb-9b9b-40d0-b226-fd57ed22373f-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4c6edacc-1bac-4816-817f-f8bdc8258ea9 tempest-VolumesTestJSON-1295381596 None] Lock "cinder-6859cce4-1224-4795-9d95-da6acd4c59ad-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a4df1443-9717-4f61-85be-2294127c42ac tempest-VolumesTestJSON-1295381596 None] Lock "cinder-47e99acb-9b9b-40d0-b226-fd57ed22373f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a4df1443-9717-4f61-85be-2294127c42ac tempest-VolumesTestJSON-1295381596 None] Acquiring lock "cinder-quobyte-47e99acb-9b9b-40d0-b226-fd57ed22373f" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a4df1443-9717-4f61-85be-2294127c42ac tempest-VolumesTestJSON-1295381596 None] Lock "cinder-quobyte-47e99acb-9b9b-40d0-b226-fd57ed22373f" acquired by "delete_volume" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:07 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b752d5-c256-42e4-acf2-a1b70c874abf]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a4df1443-9717-4f61-85be-2294127c42ac tempest-VolumesTestJSON-1295381596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-47e99acb-9b9b-40d0-b226-fd57ed22373f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:07 devstack sudo[86257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-47e99acb-9b9b-40d0-b226-fd57ed22373f Feb 27 02:04:07 devstack sudo[86257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:07 devstack sudo[86254]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-34fcdce3-588c-4cff-b131-c99ac8b1bd15 tempest-GroupSnapshotsTest-487592209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a" returned: 0 in 0.797s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-34fcdce3-588c-4cff-b131-c99ac8b1bd15 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.7c4f9287-713f-4a87-812f-848169b53368 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:07 devstack sudo[86262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.7c4f9287-713f-4a87-812f-848169b53368 1G Feb 27 02:04:07 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:07 devstack sudo[86257]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a4df1443-9717-4f61-85be-2294127c42ac tempest-VolumesTestJSON-1295381596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-47e99acb-9b9b-40d0-b226-fd57ed22373f" returned: 0 in 0.632s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a4df1443-9717-4f61-85be-2294127c42ac tempest-VolumesTestJSON-1295381596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-47e99acb-9b9b-40d0-b226-fd57ed22373f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:07 devstack sudo[86267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-47e99acb-9b9b-40d0-b226-fd57ed22373f Feb 27 02:04:07 devstack sudo[86267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:08 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-34fcdce3-588c-4cff-b131-c99ac8b1bd15 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.7c4f9287-713f-4a87-812f-848169b53368 1G" returned: 0 in 0.872s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-34fcdce3-588c-4cff-b131-c99ac8b1bd15 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b2317f9-1434-4d85-b4a0-d55680e0862a -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.7c4f9287-713f-4a87-812f-848169b53368 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:08 devstack sudo[86279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b2317f9-1434-4d85-b4a0-d55680e0862a -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.7c4f9287-713f-4a87-812f-848169b53368 Feb 27 02:04:08 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:08 devstack sudo[86267]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a4df1443-9717-4f61-85be-2294127c42ac tempest-VolumesTestJSON-1295381596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-47e99acb-9b9b-40d0-b226-fd57ed22373f" returned: 0 in 1.010s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:08 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a4df1443-9717-4f61-85be-2294127c42ac tempest-VolumesTestJSON-1295381596 None] Lock "cinder-quobyte-47e99acb-9b9b-40d0-b226-fd57ed22373f" released by "delete_volume" :: held 1.672s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:08 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-a4df1443-9717-4f61-85be-2294127c42ac tempest-VolumesTestJSON-1295381596 None] Created reservations ['06c9d74d-f853-4b00-8dc6-96d1eecb378f', '9323678f-5c61-4d79-a445-f50c88aa01cd', '0f15d181-ca02-47ea-8369-4be8860595c7', '4e2412a9-86f1-4b93-894c-aeec11a99615'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a4df1443-9717-4f61-85be-2294127c42ac tempest-VolumesTestJSON-1295381596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a4df1443-9717-4f61-85be-2294127c42ac tempest-VolumesTestJSON-1295381596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:08 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a4df1443-9717-4f61-85be-2294127c42ac tempest-VolumesTestJSON-1295381596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:08 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a4df1443-9717-4f61-85be-2294127c42ac tempest-VolumesTestJSON-1295381596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a4df1443-9717-4f61-85be-2294127c42ac tempest-VolumesTestJSON-1295381596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a4df1443-9717-4f61-85be-2294127c42ac tempest-VolumesTestJSON-1295381596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:09 devstack sudo[86282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:04:09 devstack sudo[86282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:09 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-34fcdce3-588c-4cff-b131-c99ac8b1bd15 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b2317f9-1434-4d85-b4a0-d55680e0862a -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.7c4f9287-713f-4a87-812f-848169b53368" returned: 0 in 0.876s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:09 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-34fcdce3-588c-4cff-b131-c99ac8b1bd15 tempest-GroupSnapshotsTest-487592209 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.7c4f9287-713f-4a87-812f-848169b53368 is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:04:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-34fcdce3-588c-4cff-b131-c99ac8b1bd15 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.7c4f9287-713f-4a87-812f-848169b53368 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:09 devstack sudo[86287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.7c4f9287-713f-4a87-812f-848169b53368 Feb 27 02:04:09 devstack sudo[86287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:09 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0cd6344f-d5eb-4966-8076-9757b59ec6ea tempest-VolumesTestJSON-1295381596 None] Acquiring lock "cinder-10c8512c-eb87-4b48-8bbe-bfd7835fef6e-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:09 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0cd6344f-d5eb-4966-8076-9757b59ec6ea tempest-VolumesTestJSON-1295381596 None] Lock "cinder-10c8512c-eb87-4b48-8bbe-bfd7835fef6e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:09 devstack cinder-volume[82683]: DEBUG oslo_service.periodic_task [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:04:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:09 devstack sudo[86289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:04:09 devstack sudo[86289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:09 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0cd6344f-d5eb-4966-8076-9757b59ec6ea tempest-VolumesTestJSON-1295381596 None] Acquiring lock "cinder-quobyte-10c8512c-eb87-4b48-8bbe-bfd7835fef6e" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:09 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0cd6344f-d5eb-4966-8076-9757b59ec6ea tempest-VolumesTestJSON-1295381596 None] Lock "cinder-quobyte-10c8512c-eb87-4b48-8bbe-bfd7835fef6e" acquired by "delete_volume" :: waited 0.022s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:09 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fe44fb-1346-4895-8a15-ba1ad39977cb]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0cd6344f-d5eb-4966-8076-9757b59ec6ea tempest-VolumesTestJSON-1295381596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-10c8512c-eb87-4b48-8bbe-bfd7835fef6e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:09 devstack sudo[86291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-10c8512c-eb87-4b48-8bbe-bfd7835fef6e Feb 27 02:04:09 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:10 devstack sudo[86282]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a4df1443-9717-4f61-85be-2294127c42ac tempest-VolumesTestJSON-1295381596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 1.160s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:10 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-a4df1443-9717-4f61-85be-2294127c42ac tempest-VolumesTestJSON-1295381596 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:10 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-a4df1443-9717-4f61-85be-2294127c42ac tempest-VolumesTestJSON-1295381596 None] Deleted volume successfully. Feb 27 02:04:10 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:SELECT=182,cinder:INSERT=51,cinder:UPDATE=207,cinder:DELETE=14 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:04:10 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a4df1443-9717-4f61-85be-2294127c42ac tempest-VolumesTestJSON-1295381596 None] Lock "cinder-47e99acb-9b9b-40d0-b226-fd57ed22373f-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:10 devstack sudo[86289]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.839s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:10 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:10 devstack sudo[86287]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-34fcdce3-588c-4cff-b131-c99ac8b1bd15 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.7c4f9287-713f-4a87-812f-848169b53368" returned: 0 in 1.315s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:10 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:UPDATE=224,cinder:SELECT=176,cinder:INSERT=49,cinder:DELETE=12 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:04:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-34fcdce3-588c-4cff-b131-c99ac8b1bd15 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:10 devstack sudo[86296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.info Feb 27 02:04:10 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:10 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Flow 'volume_create_manager' (d2f888f2-bbb5-4fe3-a18b-42e00f505b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4a460e-b1a4-480c-a71f-70b48e466e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:10 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4a460e-b1a4-480c-a71f-70b48e466e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:11Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e5a42f9-123a-40b7-81da-2e62b0a0c064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24236992899465fa8ea61c589ab3708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:11Z,use_quota=True,user_id='06dca7fac38749348b7c60ab187bed56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3300eb42-ef18-4e7a-90b6-895bf0715deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3300eb42-ef18-4e7a-90b6-895bf0715deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162bcefe-85c8-4a31-bdbe-d53b932d5652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:10 devstack cinder-volume[82683]: DEBUG cinder.image.glance [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Creating Keystone auth plugin from conf {{(pid=82683) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 02:04:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0cd6344f-d5eb-4966-8076-9757b59ec6ea tempest-VolumesTestJSON-1295381596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-10c8512c-eb87-4b48-8bbe-bfd7835fef6e" returned: 0 in 1.434s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0cd6344f-d5eb-4966-8076-9757b59ec6ea tempest-VolumesTestJSON-1295381596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-10c8512c-eb87-4b48-8bbe-bfd7835fef6e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:10 devstack sudo[86303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-10c8512c-eb87-4b48-8bbe-bfd7835fef6e Feb 27 02:04:10 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (162bcefe-85c8-4a31-bdbe-d53b932d5652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9e5a42f9-123a-40b7-81da-2e62b0a0c064', 'volume_name': 'volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064', 'volume_size': 1, 'image_id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '757f43b353254b8d946a078a47db0c70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1936e0bd-39f5-48aa-82e1-d79c80c86062/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b33cd2-e712-4044-8940-4421d9c7c8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b33cd2-e712-4044-8940-4421d9c7c8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90fee025-14dd-496b-a2b1-062c5b4d2396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:11 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Volume 9e5a42f9-123a-40b7-81da-2e62b0a0c064: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064', 'volume_size': 1, 'image_id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '757f43b353254b8d946a078a47db0c70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1936e0bd-39f5-48aa-82e1-d79c80c86062/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 02:04:11 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Trying to clone 9e5a42f9-123a-40b7-81da-2e62b0a0c064 from image 1936e0bd-39f5-48aa-82e1-d79c80c86062 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}]). {{(pid=82683) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 02:04:11 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-34fcdce3-588c-4cff-b131-c99ac8b1bd15 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.info" returned: 0 in 1.237s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:11 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-34fcdce3-588c-4cff-b131-c99ac8b1bd15 tempest-GroupSnapshotsTest-487592209 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.info is being set with open permissions: ugo+rw: NotImplementedError Feb 27 02:04:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-34fcdce3-588c-4cff-b131-c99ac8b1bd15 tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:11 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0cd6344f-d5eb-4966-8076-9757b59ec6ea tempest-VolumesTestJSON-1295381596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-10c8512c-eb87-4b48-8bbe-bfd7835fef6e" returned: 0 in 0.961s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:11 devstack sudo[86328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.info Feb 27 02:04:11 devstack sudo[86328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:11 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_apb1ga4odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82683) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 02:04:11 devstack cinder-volume[82683]: INFO cinder.image.image_utils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Image download 20.69 MB at 20.69 MB/s Feb 27 02:04:11 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0cd6344f-d5eb-4966-8076-9757b59ec6ea tempest-VolumesTestJSON-1295381596 None] Lock "cinder-quobyte-10c8512c-eb87-4b48-8bbe-bfd7835fef6e" released by "delete_volume" :: held 2.443s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:12 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[759a472d-45e8-47e8-a21d-d43459b11d09]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_apb1ga4odevstack@QuobyteHD {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:12 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-0cd6344f-d5eb-4966-8076-9757b59ec6ea tempest-VolumesTestJSON-1295381596 None] Created reservations ['ba9e3e58-e8b9-4331-8b9c-96856dcec6a0', 'e3ee18c5-9cad-485f-b22b-5b5cd9a0a3cb', '37066e01-89ec-49e4-b483-09ab8b0785b1', '9d34e5a7-6724-4b40-8b48-9e86a020f36a'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:12 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_apb1ga4odevstack@QuobyteHD Feb 27 02:04:12 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0cd6344f-d5eb-4966-8076-9757b59ec6ea tempest-VolumesTestJSON-1295381596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0cd6344f-d5eb-4966-8076-9757b59ec6ea tempest-VolumesTestJSON-1295381596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:12 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0cd6344f-d5eb-4966-8076-9757b59ec6ea tempest-VolumesTestJSON-1295381596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:12 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0cd6344f-d5eb-4966-8076-9757b59ec6ea tempest-VolumesTestJSON-1295381596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0cd6344f-d5eb-4966-8076-9757b59ec6ea tempest-VolumesTestJSON-1295381596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0cd6344f-d5eb-4966-8076-9757b59ec6ea tempest-VolumesTestJSON-1295381596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:12 devstack sudo[86332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:04:12 devstack sudo[86332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:12 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_apb1ga4odevstack@QuobyteHD" returned: 0 in 0.720s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:12 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Temporary image 1936e0bd-39f5-48aa-82e1-d79c80c86062 is fetched for user 06dca7fac38749348b7c60ab187bed56. {{(pid=82683) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 02:04:12 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9aeaa5-8ee5-43e6-bb99-2bd7e04b6cd9]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_apb1ga4odevstack@QuobyteHD {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:13 devstack sudo[86338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_apb1ga4odevstack@QuobyteHD Feb 27 02:04:13 devstack sudo[86338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:13 devstack sudo[86328]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-34fcdce3-588c-4cff-b131-c99ac8b1bd15 tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.info" returned: 0 in 1.377s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-34fcdce3-588c-4cff-b131-c99ac8b1bd15 tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.553s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:13 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-34fcdce3-588c-4cff-b131-c99ac8b1bd15 tempest-GroupSnapshotsTest-487592209 None] group_snapshot ad30ef69-19de-4433-8bd1-d604d1000c9b: created successfully Feb 27 02:04:13 devstack sudo[86332]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0cd6344f-d5eb-4966-8076-9757b59ec6ea tempest-VolumesTestJSON-1295381596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 1.515s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:13 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-0cd6344f-d5eb-4966-8076-9757b59ec6ea tempest-VolumesTestJSON-1295381596 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:13 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-0cd6344f-d5eb-4966-8076-9757b59ec6ea tempest-VolumesTestJSON-1295381596 None] Deleted volume successfully. Feb 27 02:04:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0cd6344f-d5eb-4966-8076-9757b59ec6ea tempest-VolumesTestJSON-1295381596 None] Lock "cinder-10c8512c-eb87-4b48-8bbe-bfd7835fef6e-delete_volume" released by "delete_volume" :: held 4.401s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:13 devstack sudo[86338]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_apb1ga4odevstack@QuobyteHD" returned: 0 in 1.072s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:11Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e5a42f9-123a-40b7-81da-2e62b0a0c064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24236992899465fa8ea61c589ab3708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:11Z,use_quota=True,user_id='06dca7fac38749348b7c60ab187bed56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Creating volume 9e5a42f9-123a-40b7-81da-2e62b0a0c064 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:13 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:04:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:13 devstack sudo[86345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 1073741824 Feb 27 02:04:13 devstack sudo[86345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:14 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] group_snapshot ad30ef69-19de-4433-8bd1-d604d1000c9b: deleting Feb 27 02:04:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] group_snapshot ad30ef69-19de-4433-8bd1-d604d1000c9b: deleting {{(pid=82683) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 27 02:04:14 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "cinder-quobyte-9b2317f9-1434-4d85-b4a0-d55680e0862a" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:14 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-9b2317f9-1434-4d85-b4a0-d55680e0862a" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:14 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "cinder-quobyte-7c4f9287-713f-4a87-812f-848169b53368" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:14 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-7c4f9287-713f-4a87-812f-848169b53368" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] Deleting offline snapshot 7c4f9287-713f-4a87-812f-848169b53368 of volume 9b2317f9-1434-4d85-b4a0-d55680e0862a {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:04:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] snapshot_file for this snap is: volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.7c4f9287-713f-4a87-812f-848169b53368 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:04:14 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a22794-8c1b-47eb-b96d-43367adf73e8]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.7c4f9287-713f-4a87-812f-848169b53368 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:14 devstack sudo[86347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.7c4f9287-713f-4a87-812f-848169b53368 Feb 27 02:04:14 devstack sudo[86347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:15 devstack sudo[86345]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 1073741824" returned: 0 in 1.263s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:15 devstack sudo[86357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 Feb 27 02:04:15 devstack sudo[86357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:15 devstack sudo[86347]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.7c4f9287-713f-4a87-812f-848169b53368" returned: 0 in 1.028s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:15 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b2317f9-1434-4d85-b4a0-d55680e0862a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:15 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ee68ce-2eff-4c59-b39a-71a99eeafabf]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:15 devstack sudo[86361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a Feb 27 02:04:15 devstack sudo[86361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:16 devstack sudo[86357]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064" returned: 0 in 1.199s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] <== create_volume: return (2509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.512s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:16 devstack cinder-volume[82683]: DEBUG cinder.volume.volume_utils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Attempting download of 1936e0bd-39f5-48aa-82e1-d79c80c86062 ((None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}])) to volume 9e5a42f9-123a-40b7-81da-2e62b0a0c064. {{(pid=82683) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 02:04:16 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[de83c041-a576-49bf-941e-ffde4f728934]: (4, 'raw') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_1pxr7xd7 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:16 devstack sudo[86361]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a" returned: 0 in 1.140s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.7c4f9287-713f-4a87-812f-848169b53368 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:16 devstack sudo[86388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.7c4f9287-713f-4a87-812f-848169b53368 Feb 27 02:04:16 devstack sudo[86388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:16 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_1pxr7xd7 Feb 27 02:04:16 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:17 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_1pxr7xd7" returned: 0 in 0.847s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_1pxr7xd7 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:17 devstack sudo[86396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_1pxr7xd7 Feb 27 02:04:17 devstack sudo[86396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:17 devstack sudo[86388]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.7c4f9287-713f-4a87-812f-848169b53368" returned: 0 in 1.122s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.7c4f9287-713f-4a87-812f-848169b53368 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:17 devstack sudo[86398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.7c4f9287-713f-4a87-812f-848169b53368 Feb 27 02:04:17 devstack sudo[86398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:18 devstack sudo[86396]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_1pxr7xd7" returned: 1 in 0.776s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_1pxr7xd7' failed. Not Retrying. {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:04:18 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d018ef11-416d-4f34-976b-e22d9804889d]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_apb1ga4odevstack@QuobyteHD {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:18 devstack sudo[86403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_apb1ga4odevstack@QuobyteHD Feb 27 02:04:18 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:18 devstack sudo[86398]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a.7c4f9287-713f-4a87-812f-848169b53368" returned: 0 in 0.775s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-7c4f9287-713f-4a87-812f-848169b53368" released by "_delete_snapshot" :: held 4.135s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-9b2317f9-1434-4d85-b4a0-d55680e0862a" released by "delete_snapshot" :: held 4.155s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:18 devstack cinder-volume[82683]: WARNING cinder.quota [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1644260865 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1644260865, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:04:18 devstack cinder-volume[82683]: WARNING cinder.quota [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1644260865 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1644260865, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:04:18 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] Created reservations ['cfbd75ac-ec36-4daf-a226-eaa9de090cce', 'efd7a28b-7382-4a12-b06b-385ab4224d71', '9175b2ef-45bc-4980-b1f9-03f480f920ae', '64e28112-80ce-42d7-8bf2-9c61319047b1'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:18 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-ba9f9e0f-bb88-4531-87ab-33717e3de71e tempest-GroupSnapshotsTest-487592209 None] group_snapshot ad30ef69-19de-4433-8bd1-d604d1000c9b: deleted successfully Feb 27 02:04:19 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_apb1ga4odevstack@QuobyteHD" returned: 0 in 1.169s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] 1936e0bd-39f5-48aa-82e1-d79c80c86062 was qcow2, converting to raw {{(pid=82683) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_apb1ga4odevstack@QuobyteHD /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:19 devstack sudo[86409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_apb1ga4odevstack@QuobyteHD /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 Feb 27 02:04:19 devstack sudo[86409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Flow 'volume_create_manager' (8f3a23a6-54e4-4464-88d3-47875ac346aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1426456-e2c4-4f8b-a650-fe31aad1a6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1426456-e2c4-4f8b-a650-fe31aad1a6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1766668369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1110b59b-04c5-4975-9085-1a24ae4fdf45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91642d0665b64c458b342167573f52d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:20Z,use_quota=True,user_id='d60579f204da40c9a98ba0e84cd3f28d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9d3fc5-fa1f-44f1-9b45-9a0146eac70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9d3fc5-fa1f-44f1-9b45-9a0146eac70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d83144c-7fca-432b-935f-b21e79b278b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d83144c-7fca-432b-935f-b21e79b278b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1110b59b-04c5-4975-9085-1a24ae4fdf45', 'volume_name': 'volume-1110b59b-04c5-4975-9085-1a24ae4fdf45', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25ac6e0-c9b8-4f7a-8365-e859b3052c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25ac6e0-c9b8-4f7a-8365-e859b3052c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1caa6a5f-33e3-44a1-9d64-9ef7fb81426c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:19 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Volume 1110b59b-04c5-4975-9085-1a24ae4fdf45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1110b59b-04c5-4975-9085-1a24ae4fdf45', 'volume_size': 1} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1766668369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1110b59b-04c5-4975-9085-1a24ae4fdf45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91642d0665b64c458b342167573f52d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:20Z,use_quota=True,user_id='d60579f204da40c9a98ba0e84cd3f28d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Creating volume 1110b59b-04c5-4975-9085-1a24ae4fdf45 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:19 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:04:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:19 devstack sudo[86426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 1073741824 Feb 27 02:04:19 devstack sudo[86426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:20 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4925eb32-8be9-4335-b1c9-c5480625a13b tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "cinder-quobyte-9b2317f9-1434-4d85-b4a0-d55680e0862a" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:20 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4925eb32-8be9-4335-b1c9-c5480625a13b tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-9b2317f9-1434-4d85-b4a0-d55680e0862a" acquired by "delete_volume" :: waited 0.030s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:20 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d07120-15a5-494a-9dc0-d844c9e3c2db]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4925eb32-8be9-4335-b1c9-c5480625a13b tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:20 devstack sudo[86428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a Feb 27 02:04:20 devstack sudo[86428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:20 devstack sudo[86409]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_apb1ga4odevstack@QuobyteHD /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064" returned: 0 in 1.361s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:20 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_apb1ga4odevstack@QuobyteHD, size 112.00 MB, duration 1.36 sec, destination /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 {{(pid=82683) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:04:20 devstack cinder-volume[82683]: INFO cinder.image.image_utils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Converted 112.00 MB image at 82.21 MB/s Feb 27 02:04:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:20 devstack sudo[86433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 1G Feb 27 02:04:20 devstack sudo[86433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:20 devstack sudo[86426]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 1073741824" returned: 0 in 1.008s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:20 devstack sudo[86436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 Feb 27 02:04:20 devstack sudo[86436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:21 devstack sudo[86428]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4925eb32-8be9-4335-b1c9-c5480625a13b tempest-GroupSnapshotsTest-487592209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a" returned: 0 in 0.748s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4925eb32-8be9-4335-b1c9-c5480625a13b tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:21 devstack sudo[86440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a Feb 27 02:04:21 devstack sudo[86440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:21 devstack sudo[86433]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 1G" returned: 0 in 0.817s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:21 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0a6872-446d-4a6f-9518-444ab632ca6c]: (4, 'raw') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:21 devstack sudo[86436]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45" returned: 0 in 0.665s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:21 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1caa6a5f-33e3-44a1-9d64-9ef7fb81426c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1110b59b-04c5-4975-9085-1a24ae4fdf45', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2cbd5f-fb4f-4067-bde8-e245627bb6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:21 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Volume volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 (1110b59b-04c5-4975-9085-1a24ae4fdf45): created successfully Feb 27 02:04:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2cbd5f-fb4f-4067-bde8-e245627bb6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:21 devstack sudo[86446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 Feb 27 02:04:21 devstack sudo[86446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Flow 'volume_create_manager' (8f3a23a6-54e4-4464-88d3-47875ac346aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:21 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-dd3ef5f9-cf08-4f09-b679-95480d64999c tempest-VolumesActionsTest-682815822 None] Created volume successfully. Feb 27 02:04:21 devstack sudo[86440]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4925eb32-8be9-4335-b1c9-c5480625a13b tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9b2317f9-1434-4d85-b4a0-d55680e0862a" returned: 0 in 0.879s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:21 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4925eb32-8be9-4335-b1c9-c5480625a13b tempest-GroupSnapshotsTest-487592209 None] Lock "cinder-quobyte-9b2317f9-1434-4d85-b4a0-d55680e0862a" released by "delete_volume" :: held 1.692s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:22 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-4925eb32-8be9-4335-b1c9-c5480625a13b tempest-GroupSnapshotsTest-487592209 None] Created reservations ['9daf536f-cbcb-4e24-a832-421fdc011136'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:22 devstack cinder-volume[82683]: WARNING cinder.quota [None req-4925eb32-8be9-4335-b1c9-c5480625a13b tempest-GroupSnapshotsTest-487592209 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1644260865 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1644260865, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:04:22 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-4925eb32-8be9-4335-b1c9-c5480625a13b tempest-GroupSnapshotsTest-487592209 None] Created reservations ['27289ad4-3e97-4b66-9ae9-33605509d558', 'e12917aa-6908-4c31-8100-9c4112df4c80', 'ae87ba80-e9fa-4b8c-bc25-d82d6af27201', '0ee9e83e-64a1-462b-943a-b4680fe19702'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4925eb32-8be9-4335-b1c9-c5480625a13b tempest-GroupSnapshotsTest-487592209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4925eb32-8be9-4335-b1c9-c5480625a13b tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4925eb32-8be9-4335-b1c9-c5480625a13b tempest-GroupSnapshotsTest-487592209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4925eb32-8be9-4335-b1c9-c5480625a13b tempest-GroupSnapshotsTest-487592209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4925eb32-8be9-4335-b1c9-c5480625a13b tempest-GroupSnapshotsTest-487592209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4925eb32-8be9-4335-b1c9-c5480625a13b tempest-GroupSnapshotsTest-487592209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:22 devstack sudo[86449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:04:22 devstack sudo[86449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:22 devstack sudo[86446]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064" returned: 0 in 1.055s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:22 devstack sudo[86453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 Feb 27 02:04:22 devstack sudo[86453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:23 devstack sudo[86449]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4925eb32-8be9-4335-b1c9-c5480625a13b tempest-GroupSnapshotsTest-487592209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 1.034s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:23 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-4925eb32-8be9-4335-b1c9-c5480625a13b tempest-GroupSnapshotsTest-487592209 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:23 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-4925eb32-8be9-4335-b1c9-c5480625a13b tempest-GroupSnapshotsTest-487592209 None] Delete group completed successfully. Feb 27 02:04:23 devstack sudo[86453]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064" returned: 1 in 0.954s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064' failed. Not Retrying. {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:04:23 devstack cinder-volume[82683]: DEBUG cinder.volume.volume_utils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Downloaded image 1936e0bd-39f5-48aa-82e1-d79c80c86062 ((None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}])) to volume 9e5a42f9-123a-40b7-81da-2e62b0a0c064 successfully. {{(pid=82683) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 02:04:23 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Temporary image 1936e0bd-39f5-48aa-82e1-d79c80c86062 for user 06dca7fac38749348b7c60ab187bed56 is deleted. {{(pid=82683) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 02:04:23 devstack cinder-volume[82683]: DEBUG cinder.volume.volume_utils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Marking volume 9e5a42f9-123a-40b7-81da-2e62b0a0c064 as bootable. {{(pid=82683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 02:04:23 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Copying metadata from image 1936e0bd-39f5-48aa-82e1-d79c80c86062 to 9e5a42f9-123a-40b7-81da-2e62b0a0c064. {{(pid=82683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 02:04:23 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Creating volume glance metadata for volume 9e5a42f9-123a-40b7-81da-2e62b0a0c064 backed by image 1936e0bd-39f5-48aa-82e1-d79c80c86062 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82683) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 02:04:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90fee025-14dd-496b-a2b1-062c5b4d2396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064', 'volume_size': 1, 'image_id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '757f43b353254b8d946a078a47db0c70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1936e0bd-39f5-48aa-82e1-d79c80c86062/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02334ce5-aa75-4485-a247-c9011965cd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:23 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Volume volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 (9e5a42f9-123a-40b7-81da-2e62b0a0c064): created successfully Feb 27 02:04:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02334ce5-aa75-4485-a247-c9011965cd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Flow 'volume_create_manager' (d2f888f2-bbb5-4fe3-a18b-42e00f505b0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:23 devstack cinder-volume[82683]: INFO cinder.volume.manager [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-dac34fcd-71b2-4ed7-b9c1-526d2e49fa40 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Created volume successfully. Feb 27 02:04:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-5b2dd777-14b6-4375-ad6d-289a3268e5f2 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-5b2dd777-14b6-4375-ad6d-289a3268e5f2 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:26 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e37a93-9fc6-482a-93b5-f76ca50f7570]: (4, 'raw') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-5b2dd777-14b6-4375-ad6d-289a3268e5f2 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:27 devstack sudo[86484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 Feb 27 02:04:27 devstack sudo[86484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:27 devstack sudo[86484]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-5b2dd777-14b6-4375-ad6d-289a3268e5f2 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064" returned: 0 in 0.977s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-5b2dd777-14b6-4375-ad6d-289a3268e5f2 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:28 devstack sudo[86488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 Feb 27 02:04:28 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:28 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-5b2dd777-14b6-4375-ad6d-289a3268e5f2 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064" returned: 1 in 0.949s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-5b2dd777-14b6-4375-ad6d-289a3268e5f2 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064' failed. Not Retrying. {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:04:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-5b2dd777-14b6-4375-ad6d-289a3268e5f2 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.974s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:28 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-5b2dd777-14b6-4375-ad6d-289a3268e5f2 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3', 'name': 'volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d9ba0af-14bc-43c1-b861-6fc6bc940655', 'enforce_multipath': True} {{(pid=82683) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 27 02:04:28 devstack cinder-volume[82683]: INFO cinder.volume.manager [req-5c3773af-985d-4b9f-9216-aed911f91b4e req-5b2dd777-14b6-4375-ad6d-289a3268e5f2 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] attachment_update completed successfully. Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Flow 'volume_create_manager' (37f4e3cc-2063-4530-9b51-d9f9391630fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d798a206-adc9-4367-8a3b-81e1041fb750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d798a206-adc9-4367-8a3b-81e1041fb750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1814251945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b20de2-996b-4561-9ed8-db4ead3e2115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7172b1cad9224dd885cc8df70c842f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:30Z,use_quota=True,user_id='8b2900fc5ee6442ca12b14a7962c5661',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a7884f-ae00-47d2-87d6-6e12d7fb4c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a7884f-ae00-47d2-87d6-6e12d7fb4c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6decd9b-7ba1-463e-bf5c-7b3c11652104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6decd9b-7ba1-463e-bf5c-7b3c11652104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7b20de2-996b-4561-9ed8-db4ead3e2115', 'volume_name': 'volume-d7b20de2-996b-4561-9ed8-db4ead3e2115', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b65dae9-ed38-44cc-8ac8-e626bd7f05f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b65dae9-ed38-44cc-8ac8-e626bd7f05f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5197d6a2-f27f-491a-8b7c-2677de76ae71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:30 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Volume d7b20de2-996b-4561-9ed8-db4ead3e2115: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7b20de2-996b-4561-9ed8-db4ead3e2115', 'volume_size': 1} Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1814251945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b20de2-996b-4561-9ed8-db4ead3e2115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7172b1cad9224dd885cc8df70c842f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:30Z,use_quota=True,user_id='8b2900fc5ee6442ca12b14a7962c5661',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Creating volume d7b20de2-996b-4561-9ed8-db4ead3e2115 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:30 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:04:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d7b20de2-996b-4561-9ed8-db4ead3e2115 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:30 devstack sudo[86510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d7b20de2-996b-4561-9ed8-db4ead3e2115 1073741824 Feb 27 02:04:30 devstack sudo[86510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:31 devstack sudo[86510]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d7b20de2-996b-4561-9ed8-db4ead3e2115 1073741824" returned: 0 in 0.710s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d7b20de2-996b-4561-9ed8-db4ead3e2115 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:31 devstack sudo[86515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d7b20de2-996b-4561-9ed8-db4ead3e2115 Feb 27 02:04:31 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:31 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d7b20de2-996b-4561-9ed8-db4ead3e2115" returned: 0 in 0.530s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:31 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5197d6a2-f27f-491a-8b7c-2677de76ae71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7b20de2-996b-4561-9ed8-db4ead3e2115', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea6eab3-155e-4f55-b7f5-4a21be30ab7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:31 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Volume volume-d7b20de2-996b-4561-9ed8-db4ead3e2115 (d7b20de2-996b-4561-9ed8-db4ead3e2115): created successfully Feb 27 02:04:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea6eab3-155e-4f55-b7f5-4a21be30ab7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Flow 'volume_create_manager' (37f4e3cc-2063-4530-9b51-d9f9391630fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:31 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-346bdd6c-8a74-49f0-ad63-b72acb0732cd tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Created volume successfully. Feb 27 02:04:33 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-da428fd9-cc30-49aa-9cfa-07370e66a7a5 tempest-GroupsV320Test-79505656 None] Group tempest-GroupsV320Test-Group-227891054: creating Feb 27 02:04:33 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-da428fd9-cc30-49aa-9cfa-07370e66a7a5 tempest-GroupsV320Test-79505656 None] Group tempest-GroupsV320Test-Group-227891054: created successfully Feb 27 02:04:33 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-da428fd9-cc30-49aa-9cfa-07370e66a7a5 tempest-GroupsV320Test-79505656 None] Create group completed successfully. Feb 27 02:04:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-c0802e44-0caa-446b-aed6-4d5eb784034e tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Acquiring lock "cinder-d7b20de2-996b-4561-9ed8-db4ead3e2115-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-c0802e44-0caa-446b-aed6-4d5eb784034e tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Lock "cinder-d7b20de2-996b-4561-9ed8-db4ead3e2115-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-c0802e44-0caa-446b-aed6-4d5eb784034e tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Acquiring lock "cinder-quobyte-d7b20de2-996b-4561-9ed8-db4ead3e2115" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-c0802e44-0caa-446b-aed6-4d5eb784034e tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Lock "cinder-quobyte-d7b20de2-996b-4561-9ed8-db4ead3e2115" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:33 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef63ede-1f64-4a55-a728-9f3d0ac16829]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c0802e44-0caa-446b-aed6-4d5eb784034e tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d7b20de2-996b-4561-9ed8-db4ead3e2115 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:33 devstack sudo[86528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d7b20de2-996b-4561-9ed8-db4ead3e2115 Feb 27 02:04:33 devstack sudo[86528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:33 devstack sudo[86528]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c0802e44-0caa-446b-aed6-4d5eb784034e tempest-VolumeQuotasNegativeTestJSON-1771506848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d7b20de2-996b-4561-9ed8-db4ead3e2115" returned: 0 in 0.661s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c0802e44-0caa-446b-aed6-4d5eb784034e tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d7b20de2-996b-4561-9ed8-db4ead3e2115 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:33 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d7b20de2-996b-4561-9ed8-db4ead3e2115 Feb 27 02:04:33 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:34 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-cdf21927-fd20-4a91-8ce0-c5cfa0ae65ce tempest-GroupsV320Test-79505656 None] Created reservations ['d07eee3e-9d21-4dcd-832d-f0486d0cb3fe'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:34 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c0802e44-0caa-446b-aed6-4d5eb784034e tempest-VolumeQuotasNegativeTestJSON-1771506848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d7b20de2-996b-4561-9ed8-db4ead3e2115" returned: 0 in 1.050s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:35 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-c0802e44-0caa-446b-aed6-4d5eb784034e tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Lock "cinder-quobyte-d7b20de2-996b-4561-9ed8-db4ead3e2115" released by "delete_volume" :: held 1.793s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-cdf21927-fd20-4a91-8ce0-c5cfa0ae65ce tempest-GroupsV320Test-79505656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-cdf21927-fd20-4a91-8ce0-c5cfa0ae65ce tempest-GroupsV320Test-79505656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:35 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-cdf21927-fd20-4a91-8ce0-c5cfa0ae65ce tempest-GroupsV320Test-79505656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:35 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-cdf21927-fd20-4a91-8ce0-c5cfa0ae65ce tempest-GroupsV320Test-79505656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-cdf21927-fd20-4a91-8ce0-c5cfa0ae65ce tempest-GroupsV320Test-79505656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cdf21927-fd20-4a91-8ce0-c5cfa0ae65ce tempest-GroupsV320Test-79505656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:35 devstack sudo[86590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:04:35 devstack sudo[86590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:35 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-c0802e44-0caa-446b-aed6-4d5eb784034e tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Created reservations ['2e9b059a-11cc-4673-a4dc-4b55e185626d', 'fa07059c-1ef9-4bf3-a23a-2a7fc011965e', '0635af26-6de4-472a-9901-b5bf15614db5', '4b95b6d2-30a3-44c9-833a-95b7dbf59975'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c0802e44-0caa-446b-aed6-4d5eb784034e tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c0802e44-0caa-446b-aed6-4d5eb784034e tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:35 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-c0802e44-0caa-446b-aed6-4d5eb784034e tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:35 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-c0802e44-0caa-446b-aed6-4d5eb784034e tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c0802e44-0caa-446b-aed6-4d5eb784034e tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c0802e44-0caa-446b-aed6-4d5eb784034e tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:35 devstack sudo[86593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:04:35 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:36 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c0802e44-0caa-446b-aed6-4d5eb784034e tempest-VolumeQuotasNegativeTestJSON-1771506848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 1.343s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:36 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-c0802e44-0caa-446b-aed6-4d5eb784034e tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:36 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-c0802e44-0caa-446b-aed6-4d5eb784034e tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Deleted volume successfully. Feb 27 02:04:36 devstack sudo[86590]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cdf21927-fd20-4a91-8ce0-c5cfa0ae65ce tempest-GroupsV320Test-79505656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 1.718s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:36 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-cdf21927-fd20-4a91-8ce0-c5cfa0ae65ce tempest-GroupsV320Test-79505656 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:36 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-cdf21927-fd20-4a91-8ce0-c5cfa0ae65ce tempest-GroupsV320Test-79505656 None] Delete group completed successfully. Feb 27 02:04:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-c0802e44-0caa-446b-aed6-4d5eb784034e tempest-VolumeQuotasNegativeTestJSON-1771506848 None] Lock "cinder-d7b20de2-996b-4561-9ed8-db4ead3e2115-delete_volume" released by "delete_volume" :: held 3.613s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:40 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-690d4e49-626b-4608-a3ee-b71624839b42 tempest-VolumesActionsTest-682815822 None] Acquiring lock "cinder-1110b59b-04c5-4975-9085-1a24ae4fdf45" by "attach_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:40 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-690d4e49-626b-4608-a3ee-b71624839b42 tempest-VolumesActionsTest-682815822 None] Lock "cinder-1110b59b-04c5-4975-9085-1a24ae4fdf45" acquired by "attach_volume" :: waited 0.044s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:40 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-690d4e49-626b-4608-a3ee-b71624839b42 tempest-VolumesActionsTest-682815822 None] Attaching volume 1110b59b-04c5-4975-9085-1a24ae4fdf45 to instance b375aaf9-1b7f-44d0-a33d-173a34948852 at mountpoint /dev/vdb on host None. Feb 27 02:04:40 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-690d4e49-626b-4608-a3ee-b71624839b42 tempest-VolumesActionsTest-682815822 None] Attach volume completed successfully. Feb 27 02:04:40 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-690d4e49-626b-4608-a3ee-b71624839b42 tempest-VolumesActionsTest-682815822 None] Lock "cinder-1110b59b-04c5-4975-9085-1a24ae4fdf45" released by "attach_volume" :: held 0.296s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:40 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9f8e8d6e-490d-402c-86cc-de278822e282 tempest-VolumesActionsTest-682815822 None] Acquiring lock "cinder-1110b59b-04c5-4975-9085-1a24ae4fdf45-detach_volume" by "detach_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:40 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9f8e8d6e-490d-402c-86cc-de278822e282 tempest-VolumesActionsTest-682815822 None] Lock "cinder-1110b59b-04c5-4975-9085-1a24ae4fdf45-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:40 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-9f8e8d6e-490d-402c-86cc-de278822e282 tempest-VolumesActionsTest-682815822 None] Detaching volume 1110b59b-04c5-4975-9085-1a24ae4fdf45 from instance b375aaf9-1b7f-44d0-a33d-173a34948852. Feb 27 02:04:40 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-9f8e8d6e-490d-402c-86cc-de278822e282 tempest-VolumesActionsTest-682815822 None] Detach volume completed successfully. Feb 27 02:04:40 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9f8e8d6e-490d-402c-86cc-de278822e282 tempest-VolumesActionsTest-682815822 None] Lock "cinder-1110b59b-04c5-4975-9085-1a24ae4fdf45-detach_volume" released by "detach_volume" :: held 0.084s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Flow 'volume_create_manager' (0b0c8bac-02a0-4c5a-9fb3-205737e01c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63150497-49b9-4d67-b27f-6638809ec51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63150497-49b9-4d67-b27f-6638809ec51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-737065472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d6190f-1348-4e79-bdbf-b7e4f57ac308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e3aa247b4d42e3be3a68184ce2378f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:43Z,use_quota=True,user_id='70e2fa6c0fe34f9f8df7eaf797f90c2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c570617b-243f-44bd-bb1d-dcf8dbe67502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c570617b-243f-44bd-bb1d-dcf8dbe67502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775e3bd7-19dc-48a8-994f-b5b6054112f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775e3bd7-19dc-48a8-994f-b5b6054112f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92d6190f-1348-4e79-bdbf-b7e4f57ac308', 'volume_name': 'volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a55aa61-8a41-47c1-ae53-e5631cb25667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a55aa61-8a41-47c1-ae53-e5631cb25667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b3f8e70-aa91-4f26-9e0d-4d14ce07792e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:43 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Volume 92d6190f-1348-4e79-bdbf-b7e4f57ac308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308', 'volume_size': 1} Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-737065472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d6190f-1348-4e79-bdbf-b7e4f57ac308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e3aa247b4d42e3be3a68184ce2378f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:43Z,use_quota=True,user_id='70e2fa6c0fe34f9f8df7eaf797f90c2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Creating volume 92d6190f-1348-4e79-bdbf-b7e4f57ac308 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:43 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:04:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:43 devstack sudo[86625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308 1073741824 Feb 27 02:04:43 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Flow 'volume_create_manager' (bb6c35c7-3066-4878-9a61-640e9fd0eef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699fafb6-da44-4dda-aa76-5960e2d664e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699fafb6-da44-4dda-aa76-5960e2d664e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1444233859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc38977-b1fb-4680-bcbc-54b6822026cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b566b534974267bd0078b7f172e83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:44Z,use_quota=True,user_id='8c6488404297432c98203410b2492b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd761836-8a27-4cf9-a8d1-dd71d12a98ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd761836-8a27-4cf9-a8d1-dd71d12a98ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c02f99-9d16-439e-b3d7-fdce14c50240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c02f99-9d16-439e-b3d7-fdce14c50240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fc38977-b1fb-4680-bcbc-54b6822026cd', 'volume_name': 'volume-9fc38977-b1fb-4680-bcbc-54b6822026cd', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b886575f-830b-482a-b0fb-d89c630468f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b886575f-830b-482a-b0fb-d89c630468f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9701541-4da7-42ef-91dc-00575c401c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:44 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Volume 9fc38977-b1fb-4680-bcbc-54b6822026cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fc38977-b1fb-4680-bcbc-54b6822026cd', 'volume_size': 1} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:44 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308 1073741824" returned: 0 in 0.917s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:44 devstack sudo[86632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308 Feb 27 02:04:44 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:44 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308" returned: 0 in 0.591s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.784s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1444233859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc38977-b1fb-4680-bcbc-54b6822026cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74b566b534974267bd0078b7f172e83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:44Z,use_quota=True,user_id='8c6488404297432c98203410b2492b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Creating volume 9fc38977-b1fb-4680-bcbc-54b6822026cd {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:44 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9fc38977-b1fb-4680-bcbc-54b6822026cd 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b3f8e70-aa91-4f26-9e0d-4d14ce07792e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0b1e9d-0723-4af2-a0c1-6f37deb3ec47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:44 devstack sudo[86653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9fc38977-b1fb-4680-bcbc-54b6822026cd 1073741824 Feb 27 02:04:44 devstack sudo[86653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:45 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Volume volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308 (92d6190f-1348-4e79-bdbf-b7e4f57ac308): created successfully Feb 27 02:04:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0b1e9d-0723-4af2-a0c1-6f37deb3ec47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Flow 'volume_create_manager' (0b0c8bac-02a0-4c5a-9fb3-205737e01c23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:45 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-ab7fd819-88df-4e25-8bb0-7f8e752e3886 tempest-SnapshotsActionsTest-968393943 None] Created volume successfully. Feb 27 02:04:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b5bd2d4c-9475-4a08-acf4-177ddb9c9ee2 tempest-SnapshotsActionsTest-968393943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:45 devstack sudo[86653]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9fc38977-b1fb-4680-bcbc-54b6822026cd 1073741824" returned: 0 in 0.738s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9fc38977-b1fb-4680-bcbc-54b6822026cd {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:45 devstack sudo[86659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9fc38977-b1fb-4680-bcbc-54b6822026cd Feb 27 02:04:45 devstack sudo[86659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:46 devstack sudo[86659]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9fc38977-b1fb-4680-bcbc-54b6822026cd" returned: 0 in 0.556s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b5bd2d4c-9475-4a08-acf4-177ddb9c9ee2 tempest-SnapshotsActionsTest-968393943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.722s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:46 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9701541-4da7-42ef-91dc-00575c401c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fc38977-b1fb-4680-bcbc-54b6822026cd', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:46 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6182d7a1-8b29-4044-8473-8e54f7c9c529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-b5bd2d4c-9475-4a08-acf4-177ddb9c9ee2 tempest-SnapshotsActionsTest-968393943 None] Creating offline snapshot 3fb64899-538d-4a85-bb8e-5be37288bac4 of volume 92d6190f-1348-4e79-bdbf-b7e4f57ac308 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:04:46 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Volume volume-9fc38977-b1fb-4680-bcbc-54b6822026cd (9fc38977-b1fb-4680-bcbc-54b6822026cd): created successfully Feb 27 02:04:46 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6182d7a1-8b29-4044-8473-8e54f7c9c529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:46 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Flow 'volume_create_manager' (bb6c35c7-3066-4878-9a61-640e9fd0eef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:46 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd4c630-29f8-418a-9695-4964b3eee5e6]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b5bd2d4c-9475-4a08-acf4-177ddb9c9ee2 tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:46 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-4001682f-ba74-4239-9aa2-ab13901394f4 tempest-VolumesServicesTestJSON-1452641900 None] Created volume successfully. Feb 27 02:04:46 devstack sudo[86663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308 Feb 27 02:04:46 devstack sudo[86663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:46 devstack sudo[86663]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b5bd2d4c-9475-4a08-acf4-177ddb9c9ee2 tempest-SnapshotsActionsTest-968393943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308" returned: 0 in 0.601s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b5bd2d4c-9475-4a08-acf4-177ddb9c9ee2 tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:47 devstack sudo[86686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 1G Feb 27 02:04:47 devstack sudo[86686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1c44c39c-5a0e-491a-ba1a-0de41c1e8eb3 tempest-VolumesServicesTestJSON-1452641900 None] Acquiring lock "cinder-9fc38977-b1fb-4680-bcbc-54b6822026cd-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1c44c39c-5a0e-491a-ba1a-0de41c1e8eb3 tempest-VolumesServicesTestJSON-1452641900 None] Lock "cinder-9fc38977-b1fb-4680-bcbc-54b6822026cd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1c44c39c-5a0e-491a-ba1a-0de41c1e8eb3 tempest-VolumesServicesTestJSON-1452641900 None] Acquiring lock "cinder-quobyte-9fc38977-b1fb-4680-bcbc-54b6822026cd" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1c44c39c-5a0e-491a-ba1a-0de41c1e8eb3 tempest-VolumesServicesTestJSON-1452641900 None] Lock "cinder-quobyte-9fc38977-b1fb-4680-bcbc-54b6822026cd" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:47 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f8280b-18d4-4423-ac12-a450fda8858b]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1c44c39c-5a0e-491a-ba1a-0de41c1e8eb3 tempest-VolumesServicesTestJSON-1452641900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9fc38977-b1fb-4680-bcbc-54b6822026cd {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:47 devstack sudo[86691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9fc38977-b1fb-4680-bcbc-54b6822026cd Feb 27 02:04:47 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:47 devstack sudo[86686]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b5bd2d4c-9475-4a08-acf4-177ddb9c9ee2 tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 1G" returned: 0 in 0.697s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b5bd2d4c-9475-4a08-acf4-177ddb9c9ee2 tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:47 devstack sudo[86693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 Feb 27 02:04:47 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:48 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1c44c39c-5a0e-491a-ba1a-0de41c1e8eb3 tempest-VolumesServicesTestJSON-1452641900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9fc38977-b1fb-4680-bcbc-54b6822026cd" returned: 0 in 0.578s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1c44c39c-5a0e-491a-ba1a-0de41c1e8eb3 tempest-VolumesServicesTestJSON-1452641900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9fc38977-b1fb-4680-bcbc-54b6822026cd {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:48 devstack sudo[86698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9fc38977-b1fb-4680-bcbc-54b6822026cd Feb 27 02:04:48 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:48 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b5bd2d4c-9475-4a08-acf4-177ddb9c9ee2 tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4" returned: 0 in 0.554s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:48 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-b5bd2d4c-9475-4a08-acf4-177ddb9c9ee2 tempest-SnapshotsActionsTest-968393943 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 is being set with open permissions: ugo+rw Feb 27 02:04:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b5bd2d4c-9475-4a08-acf4-177ddb9c9ee2 tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:48 devstack sudo[86704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 Feb 27 02:04:48 devstack sudo[86704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:48 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1c44c39c-5a0e-491a-ba1a-0de41c1e8eb3 tempest-VolumesServicesTestJSON-1452641900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9fc38977-b1fb-4680-bcbc-54b6822026cd" returned: 0 in 0.472s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:48 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1c44c39c-5a0e-491a-ba1a-0de41c1e8eb3 tempest-VolumesServicesTestJSON-1452641900 None] Lock "cinder-quobyte-9fc38977-b1fb-4680-bcbc-54b6822026cd" released by "delete_volume" :: held 1.089s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:48 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-1c44c39c-5a0e-491a-ba1a-0de41c1e8eb3 tempest-VolumesServicesTestJSON-1452641900 None] Created reservations ['79a15a48-a96c-42bc-99ca-b6b3dbcee7ae', 'ebccebf7-49a6-4ab6-afb4-e71a59aa6287', '3dbff31e-105e-49f9-8bc8-a7310b041e45', '7281b5d7-07fd-4093-9b38-ad3efd97e97b'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:04:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1c44c39c-5a0e-491a-ba1a-0de41c1e8eb3 tempest-VolumesServicesTestJSON-1452641900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1c44c39c-5a0e-491a-ba1a-0de41c1e8eb3 tempest-VolumesServicesTestJSON-1452641900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1c44c39c-5a0e-491a-ba1a-0de41c1e8eb3 tempest-VolumesServicesTestJSON-1452641900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1c44c39c-5a0e-491a-ba1a-0de41c1e8eb3 tempest-VolumesServicesTestJSON-1452641900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1c44c39c-5a0e-491a-ba1a-0de41c1e8eb3 tempest-VolumesServicesTestJSON-1452641900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1c44c39c-5a0e-491a-ba1a-0de41c1e8eb3 tempest-VolumesServicesTestJSON-1452641900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:48 devstack sudo[86708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:04:48 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:48 devstack sudo[86704]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b5bd2d4c-9475-4a08-acf4-177ddb9c9ee2 tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4" returned: 0 in 0.527s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b5bd2d4c-9475-4a08-acf4-177ddb9c9ee2 tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:48 devstack sudo[86710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.info Feb 27 02:04:48 devstack sudo[86710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:49 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1c44c39c-5a0e-491a-ba1a-0de41c1e8eb3 tempest-VolumesServicesTestJSON-1452641900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.596s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:49 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-1c44c39c-5a0e-491a-ba1a-0de41c1e8eb3 tempest-VolumesServicesTestJSON-1452641900 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:04:49 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-1c44c39c-5a0e-491a-ba1a-0de41c1e8eb3 tempest-VolumesServicesTestJSON-1452641900 None] Deleted volume successfully. Feb 27 02:04:49 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1c44c39c-5a0e-491a-ba1a-0de41c1e8eb3 tempest-VolumesServicesTestJSON-1452641900 None] Lock "cinder-9fc38977-b1fb-4680-bcbc-54b6822026cd-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:04:49 devstack sudo[86710]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b5bd2d4c-9475-4a08-acf4-177ddb9c9ee2 tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.info" returned: 0 in 0.616s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:49 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-b5bd2d4c-9475-4a08-acf4-177ddb9c9ee2 tempest-SnapshotsActionsTest-968393943 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.info is being set with open permissions: ugo+rw Feb 27 02:04:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b5bd2d4c-9475-4a08-acf4-177ddb9c9ee2 tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:49 devstack sudo[86716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.info Feb 27 02:04:49 devstack sudo[86716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:49 devstack sudo[86716]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b5bd2d4c-9475-4a08-acf4-177ddb9c9ee2 tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.info" returned: 0 in 0.525s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b5bd2d4c-9475-4a08-acf4-177ddb9c9ee2 tempest-SnapshotsActionsTest-968393943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.697s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:50 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-b5bd2d4c-9475-4a08-acf4-177ddb9c9ee2 tempest-SnapshotsActionsTest-968393943 None] Create snapshot completed successfully Feb 27 02:04:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-83454edb-32ed-4d63-8767-e9584d035f7f tempest-SnapshotsActionsTest-968393943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-83454edb-32ed-4d63-8767-e9584d035f7f tempest-SnapshotsActionsTest-968393943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:51 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-83454edb-32ed-4d63-8767-e9584d035f7f tempest-SnapshotsActionsTest-968393943 None] Creating offline snapshot 3e1eceda-2875-462a-9dc9-6dd84a15bb25 of volume 92d6190f-1348-4e79-bdbf-b7e4f57ac308 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:04:51 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fea0707-5dd2-4c45-8452-edab993b3589]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83454edb-32ed-4d63-8767-e9584d035f7f tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:51 devstack sudo[86747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 Feb 27 02:04:51 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:52 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83454edb-32ed-4d63-8767-e9584d035f7f tempest-SnapshotsActionsTest-968393943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4" returned: 0 in 0.861s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:52 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-83454edb-32ed-4d63-8767-e9584d035f7f tempest-SnapshotsActionsTest-968393943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83454edb-32ed-4d63-8767-e9584d035f7f tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3e1eceda-2875-462a-9dc9-6dd84a15bb25 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:52 devstack sudo[86753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3e1eceda-2875-462a-9dc9-6dd84a15bb25 1G Feb 27 02:04:52 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:53 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83454edb-32ed-4d63-8767-e9584d035f7f tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3e1eceda-2875-462a-9dc9-6dd84a15bb25 1G" returned: 0 in 0.803s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83454edb-32ed-4d63-8767-e9584d035f7f tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3e1eceda-2875-462a-9dc9-6dd84a15bb25 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:53 devstack sudo[86758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3e1eceda-2875-462a-9dc9-6dd84a15bb25 Feb 27 02:04:53 devstack sudo[86758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:54 devstack sudo[86758]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83454edb-32ed-4d63-8767-e9584d035f7f tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3e1eceda-2875-462a-9dc9-6dd84a15bb25" returned: 0 in 0.748s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:54 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-83454edb-32ed-4d63-8767-e9584d035f7f tempest-SnapshotsActionsTest-968393943 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3e1eceda-2875-462a-9dc9-6dd84a15bb25 is being set with open permissions: ugo+rw Feb 27 02:04:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83454edb-32ed-4d63-8767-e9584d035f7f tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3e1eceda-2875-462a-9dc9-6dd84a15bb25 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:54 devstack sudo[86763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3e1eceda-2875-462a-9dc9-6dd84a15bb25 Feb 27 02:04:54 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:54 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83454edb-32ed-4d63-8767-e9584d035f7f tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3e1eceda-2875-462a-9dc9-6dd84a15bb25" returned: 0 in 0.749s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-83454edb-32ed-4d63-8767-e9584d035f7f tempest-SnapshotsActionsTest-968393943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.386s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:54 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-83454edb-32ed-4d63-8767-e9584d035f7f tempest-SnapshotsActionsTest-968393943 None] Create snapshot completed successfully Feb 27 02:04:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] Acquiring lock "cinder-3e1eceda-2875-462a-9dc9-6dd84a15bb25-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-3e1eceda-2875-462a-9dc9-6dd84a15bb25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] Acquiring lock "cinder-quobyte-92d6190f-1348-4e79-bdbf-b7e4f57ac308" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:55 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:04:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Flow 'volume_create_manager' (6875d4cf-60b4-44e2-86b8-1f164dad2b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9abf99-06e9-452d-b643-4d23fed99671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-quobyte-92d6190f-1348-4e79-bdbf-b7e4f57ac308" acquired by "delete_snapshot" :: waited 0.037s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] Acquiring lock "cinder-quobyte-3e1eceda-2875-462a-9dc9-6dd84a15bb25" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9abf99-06e9-452d-b643-4d23fed99671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-327443396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd41733f-74fc-4a0a-84a9-0a1843fd82e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='348e1ce3692d48ffb69aa032a993e604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:56Z,use_quota=True,user_id='af838e7d7d9f4f55a8545add6f980add',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c43a8d6e-9624-4c38-9736-aaac76647065),volume_type_id=c43a8d6e-9624-4c38-9736-aaac76647065)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ab80ab-5ff0-4f09-a723-68a52dfa6f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ab80ab-5ff0-4f09-a723-68a52dfa6f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ebbf33-6337-4d4d-b9b0-fe6f6a547f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ebbf33-6337-4d4d-b9b0-fe6f6a547f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd41733f-74fc-4a0a-84a9-0a1843fd82e7', 'volume_name': 'volume-bd41733f-74fc-4a0a-84a9-0a1843fd82e7', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fceb21-3140-4efa-96eb-34ef98476978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fceb21-3140-4efa-96eb-34ef98476978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43640787-9266-41bc-94fd-6cda92ffe689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:56 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Volume bd41733f-74fc-4a0a-84a9-0a1843fd82e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd41733f-74fc-4a0a-84a9-0a1843fd82e7', 'volume_size': 1} Feb 27 02:04:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-327443396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd41733f-74fc-4a0a-84a9-0a1843fd82e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='348e1ce3692d48ffb69aa032a993e604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:04:56Z,use_quota=True,user_id='af838e7d7d9f4f55a8545add6f980add',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c43a8d6e-9624-4c38-9736-aaac76647065),volume_type_id=c43a8d6e-9624-4c38-9736-aaac76647065)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:04:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Creating volume bd41733f-74fc-4a0a-84a9-0a1843fd82e7 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:04:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:04:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:04:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:04:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:04:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:04:56 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:04:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd41733f-74fc-4a0a-84a9-0a1843fd82e7 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-quobyte-3e1eceda-2875-462a-9dc9-6dd84a15bb25" acquired by "_delete_snapshot" :: waited 0.109s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] Deleting offline snapshot 3e1eceda-2875-462a-9dc9-6dd84a15bb25 of volume 92d6190f-1348-4e79-bdbf-b7e4f57ac308 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:04:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] snapshot_file for this snap is: volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3e1eceda-2875-462a-9dc9-6dd84a15bb25 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:04:56 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[733f47b5-0bb5-4b68-926f-0f336d1cfcc5]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3e1eceda-2875-462a-9dc9-6dd84a15bb25 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:56 devstack sudo[86767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd41733f-74fc-4a0a-84a9-0a1843fd82e7 1073741824 Feb 27 02:04:56 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:56 devstack sudo[86769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3e1eceda-2875-462a-9dc9-6dd84a15bb25 Feb 27 02:04:56 devstack sudo[86769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:57 devstack sudo[86769]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3e1eceda-2875-462a-9dc9-6dd84a15bb25" returned: 0 in 1.068s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:57 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd41733f-74fc-4a0a-84a9-0a1843fd82e7 1073741824" returned: 0 in 1.135s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:57 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c18fbc7-75fc-4e2a-9666-7cc18cc60b8c]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd41733f-74fc-4a0a-84a9-0a1843fd82e7 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:57 devstack sudo[86823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd41733f-74fc-4a0a-84a9-0a1843fd82e7 Feb 27 02:04:57 devstack sudo[86823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:57 devstack sudo[86813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 Feb 27 02:04:57 devstack sudo[86813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:58 devstack sudo[86823]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd41733f-74fc-4a0a-84a9-0a1843fd82e7" returned: 0 in 0.775s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:58 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:04:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:04:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43640787-9266-41bc-94fd-6cda92ffe689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd41733f-74fc-4a0a-84a9-0a1843fd82e7', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e660772-ae5f-4a5c-87fb-5e33afade482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:04:58 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Volume volume-bd41733f-74fc-4a0a-84a9-0a1843fd82e7 (bd41733f-74fc-4a0a-84a9-0a1843fd82e7): created successfully Feb 27 02:04:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e660772-ae5f-4a5c-87fb-5e33afade482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:04:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Flow 'volume_create_manager' (6875d4cf-60b4-44e2-86b8-1f164dad2b85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:04:58 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-30a9669b-271e-40a1-97d0-42cd15eb990d tempest-VolumeTypesAccessTest-139112596 None] Created volume successfully. Feb 27 02:04:58 devstack sudo[86813]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4" returned: 0 in 1.090s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:58 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:04:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3e1eceda-2875-462a-9dc9-6dd84a15bb25 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:58 devstack sudo[86844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3e1eceda-2875-462a-9dc9-6dd84a15bb25 Feb 27 02:04:58 devstack sudo[86844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:59 devstack sudo[86844]: pam_unix(sudo:session): session closed for user root Feb 27 02:04:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3e1eceda-2875-462a-9dc9-6dd84a15bb25" returned: 0 in 0.734s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:04:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3e1eceda-2875-462a-9dc9-6dd84a15bb25 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:59 devstack sudo[86852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3e1eceda-2875-462a-9dc9-6dd84a15bb25 Feb 27 02:04:59 devstack sudo[86852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:04:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] Acquiring lock "cinder-bd41733f-74fc-4a0a-84a9-0a1843fd82e7-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] Lock "cinder-bd41733f-74fc-4a0a-84a9-0a1843fd82e7-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] Acquiring lock "cinder-quobyte-bd41733f-74fc-4a0a-84a9-0a1843fd82e7" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:04:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] Lock "cinder-quobyte-bd41733f-74fc-4a0a-84a9-0a1843fd82e7" acquired by "delete_volume" :: waited 0.040s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:04:59 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a3e43f-3df8-43b2-8a9b-2cec0af491cc]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:04:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd41733f-74fc-4a0a-84a9-0a1843fd82e7 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:04:59 devstack sudo[86854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd41733f-74fc-4a0a-84a9-0a1843fd82e7 Feb 27 02:04:59 devstack sudo[86854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:00 devstack sudo[86852]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3e1eceda-2875-462a-9dc9-6dd84a15bb25" returned: 0 in 1.213s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:00 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-quobyte-3e1eceda-2875-462a-9dc9-6dd84a15bb25" released by "_delete_snapshot" :: held 4.189s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:00 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-quobyte-92d6190f-1348-4e79-bdbf-b7e4f57ac308" released by "delete_snapshot" :: held 4.310s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:00 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] Created reservations ['1b54e2ff-680b-4e13-954a-2654fb4d649a', 'f0dac995-780d-4dda-9f75-e6fcf5813620', 'f9156f44-7584-4b60-b304-9829c35410d2', 'abcad78e-de4e-4c09-996d-22f233779826'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:00 devstack sudo[86854]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd41733f-74fc-4a0a-84a9-0a1843fd82e7" returned: 0 in 1.031s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd41733f-74fc-4a0a-84a9-0a1843fd82e7 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:00 devstack sudo[86860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd41733f-74fc-4a0a-84a9-0a1843fd82e7 Feb 27 02:05:00 devstack sudo[86860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:00 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] Delete snapshot completed successfully. Feb 27 02:05:00 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-af6c8693-64e6-4938-9ce1-80d02120b1f2 tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-3e1eceda-2875-462a-9dc9-6dd84a15bb25-delete_snapshot" released by "delete_snapshot" :: held 4.597s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:00 devstack sudo[86860]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd41733f-74fc-4a0a-84a9-0a1843fd82e7" returned: 0 in 0.521s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:00 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] Lock "cinder-quobyte-bd41733f-74fc-4a0a-84a9-0a1843fd82e7" released by "delete_volume" :: held 1.619s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:00 devstack cinder-volume[82683]: WARNING cinder.quota [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1979001149 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1979001149, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:00 devstack cinder-volume[82683]: WARNING cinder.quota [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1979001149 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1979001149, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:00 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] Created reservations ['9f5fd4b8-b9da-493c-8de3-5d628e511e5d', 'ef6d19cd-289c-4471-9311-f8a97b388a87', 'b340478d-f15f-4cfd-b160-39bf3ba64dbc', 'bda9d8cd-8002-47c7-a4d0-cb89329bf368'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:01 devstack sudo[86873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:05:01 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8337382e-a2a6-4709-b7cf-0576099aa2f7 tempest-SnapshotsActionsTest-968393943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8337382e-a2a6-4709-b7cf-0576099aa2f7 tempest-SnapshotsActionsTest-968393943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-8337382e-a2a6-4709-b7cf-0576099aa2f7 tempest-SnapshotsActionsTest-968393943 None] Creating offline snapshot 45f22072-2779-45d9-98d5-e8aacc6b6e22 of volume 92d6190f-1348-4e79-bdbf-b7e4f57ac308 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:05:01 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3757f825-a8e5-4e81-beb7-9142a17e5d90]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8337382e-a2a6-4709-b7cf-0576099aa2f7 tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:01 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.690s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:01 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:01 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] Deleted volume successfully. Feb 27 02:05:01 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-463b4a6d-f89d-495a-8215-5fce10d9928b tempest-VolumeTypesAccessTest-139112596 None] Lock "cinder-bd41733f-74fc-4a0a-84a9-0a1843fd82e7-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:01 devstack sudo[86897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 Feb 27 02:05:01 devstack sudo[86897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:02 devstack sudo[86897]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8337382e-a2a6-4709-b7cf-0576099aa2f7 tempest-SnapshotsActionsTest-968393943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4" returned: 0 in 0.946s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:02 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-8337382e-a2a6-4709-b7cf-0576099aa2f7 tempest-SnapshotsActionsTest-968393943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8337382e-a2a6-4709-b7cf-0576099aa2f7 tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.45f22072-2779-45d9-98d5-e8aacc6b6e22 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:02 devstack sudo[86930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.45f22072-2779-45d9-98d5-e8aacc6b6e22 1G Feb 27 02:05:02 devstack sudo[86930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:04 devstack sudo[86930]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8337382e-a2a6-4709-b7cf-0576099aa2f7 tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.45f22072-2779-45d9-98d5-e8aacc6b6e22 1G" returned: 0 in 1.414s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8337382e-a2a6-4709-b7cf-0576099aa2f7 tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.45f22072-2779-45d9-98d5-e8aacc6b6e22 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:04 devstack sudo[86938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.45f22072-2779-45d9-98d5-e8aacc6b6e22 Feb 27 02:05:04 devstack sudo[86938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:04 devstack cinder-volume[82683]: INFO cinder.volume.manager [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-20fb4291-8aaa-4256-82d2-1acc494c28fc tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Terminate volume connection completed successfully. Feb 27 02:05:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-20fb4291-8aaa-4256-82d2-1acc494c28fc tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Deleting attachment 3d9ba0af-14bc-43c1-b861-6fc6bc940655. {{(pid=82683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 27 02:05:04 devstack sudo[86938]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8337382e-a2a6-4709-b7cf-0576099aa2f7 tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.45f22072-2779-45d9-98d5-e8aacc6b6e22" returned: 0 in 0.816s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:04 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-8337382e-a2a6-4709-b7cf-0576099aa2f7 tempest-SnapshotsActionsTest-968393943 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.45f22072-2779-45d9-98d5-e8aacc6b6e22 is being set with open permissions: ugo+rw Feb 27 02:05:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8337382e-a2a6-4709-b7cf-0576099aa2f7 tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.45f22072-2779-45d9-98d5-e8aacc6b6e22 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:04 devstack sudo[86943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.45f22072-2779-45d9-98d5-e8aacc6b6e22 Feb 27 02:05:04 devstack sudo[86943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:05 devstack sudo[86943]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8337382e-a2a6-4709-b7cf-0576099aa2f7 tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.45f22072-2779-45d9-98d5-e8aacc6b6e22" returned: 0 in 0.618s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8337382e-a2a6-4709-b7cf-0576099aa2f7 tempest-SnapshotsActionsTest-968393943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.906s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:05 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-8337382e-a2a6-4709-b7cf-0576099aa2f7 tempest-SnapshotsActionsTest-968393943 None] Create snapshot completed successfully Feb 27 02:05:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Acquiring lock "cinder-9e5a42f9-123a-40b7-81da-2e62b0a0c064-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "cinder-9e5a42f9-123a-40b7-81da-2e62b0a0c064-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Acquiring lock "cinder-quobyte-9e5a42f9-123a-40b7-81da-2e62b0a0c064" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "cinder-quobyte-9e5a42f9-123a-40b7-81da-2e62b0a0c064" acquired by "delete_volume" :: waited 0.031s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:05 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[02711128-0c0e-4a33-b7c4-a0bd04222659]: (4, 'raw') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3fb2503e-dde5-47db-bdb7-3242998f7b92 tempest-VolumesActionsTest-682815822 None] Acquiring lock "cinder-1110b59b-04c5-4975-9085-1a24ae4fdf45" by "attach_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3fb2503e-dde5-47db-bdb7-3242998f7b92 tempest-VolumesActionsTest-682815822 None] Lock "cinder-1110b59b-04c5-4975-9085-1a24ae4fdf45" acquired by "attach_volume" :: waited 0.021s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:06 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-3fb2503e-dde5-47db-bdb7-3242998f7b92 tempest-VolumesActionsTest-682815822 None] Attaching volume 1110b59b-04c5-4975-9085-1a24ae4fdf45 to instance 80932bae-8e01-484c-ba63-719e0c088d2f at mountpoint /dev/vdb on host None. Feb 27 02:05:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] Acquiring lock "cinder-45f22072-2779-45d9-98d5-e8aacc6b6e22-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:06 devstack sudo[86980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 Feb 27 02:05:06 devstack sudo[86980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:06 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-3fb2503e-dde5-47db-bdb7-3242998f7b92 tempest-VolumesActionsTest-682815822 None] Attach volume completed successfully. Feb 27 02:05:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3fb2503e-dde5-47db-bdb7-3242998f7b92 tempest-VolumesActionsTest-682815822 None] Lock "cinder-1110b59b-04c5-4975-9085-1a24ae4fdf45" released by "attach_volume" :: held 0.116s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-45f22072-2779-45d9-98d5-e8aacc6b6e22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] Acquiring lock "cinder-quobyte-92d6190f-1348-4e79-bdbf-b7e4f57ac308" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-quobyte-92d6190f-1348-4e79-bdbf-b7e4f57ac308" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] Acquiring lock "cinder-quobyte-45f22072-2779-45d9-98d5-e8aacc6b6e22" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-quobyte-45f22072-2779-45d9-98d5-e8aacc6b6e22" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:06 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] Deleting offline snapshot 45f22072-2779-45d9-98d5-e8aacc6b6e22 of volume 92d6190f-1348-4e79-bdbf-b7e4f57ac308 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:05:06 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] snapshot_file for this snap is: volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.45f22072-2779-45d9-98d5-e8aacc6b6e22 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:05:06 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbd68c3-38c8-4a77-a7e5-d69b54e5d4cc]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.45f22072-2779-45d9-98d5-e8aacc6b6e22 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:06 devstack sudo[86982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.45f22072-2779-45d9-98d5-e8aacc6b6e22 Feb 27 02:05:06 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-c14f0a30-c544-481d-b079-9d36cce358f2 tempest-VolumesActionsTest-682815822 None] Acquiring lock "cinder-1110b59b-04c5-4975-9085-1a24ae4fdf45-detach_volume" by "detach_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-c14f0a30-c544-481d-b079-9d36cce358f2 tempest-VolumesActionsTest-682815822 None] Lock "cinder-1110b59b-04c5-4975-9085-1a24ae4fdf45-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:06 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-c14f0a30-c544-481d-b079-9d36cce358f2 tempest-VolumesActionsTest-682815822 None] Detaching volume 1110b59b-04c5-4975-9085-1a24ae4fdf45 from instance 80932bae-8e01-484c-ba63-719e0c088d2f. Feb 27 02:05:06 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-c14f0a30-c544-481d-b079-9d36cce358f2 tempest-VolumesActionsTest-682815822 None] Detach volume completed successfully. Feb 27 02:05:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-c14f0a30-c544-481d-b079-9d36cce358f2 tempest-VolumesActionsTest-682815822 None] Lock "cinder-1110b59b-04c5-4975-9085-1a24ae4fdf45-detach_volume" released by "detach_volume" :: held 0.067s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:06 devstack sudo[86980]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064" returned: 0 in 0.928s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:06 devstack sudo[86986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 Feb 27 02:05:06 devstack sudo[86986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:06 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.45f22072-2779-45d9-98d5-e8aacc6b6e22" returned: 0 in 0.803s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:06 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:06 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cfdf83-33a1-4d4b-a2c9-fe1f4cc1a28d]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:07 devstack sudo[86991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 Feb 27 02:05:07 devstack sudo[86991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:07 devstack sudo[86986]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064" returned: 1 in 0.881s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064' failed. Not Retrying. {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:05:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:07 devstack sudo[86999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064 Feb 27 02:05:07 devstack sudo[86999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:07 devstack sudo[86991]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4" returned: 0 in 0.795s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:07 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.45f22072-2779-45d9-98d5-e8aacc6b6e22 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:07 devstack sudo[87001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.45f22072-2779-45d9-98d5-e8aacc6b6e22 Feb 27 02:05:07 devstack sudo[87001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:08 devstack sudo[86999]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e5a42f9-123a-40b7-81da-2e62b0a0c064" returned: 0 in 0.599s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:08 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "cinder-quobyte-9e5a42f9-123a-40b7-81da-2e62b0a0c064" released by "delete_volume" :: held 2.538s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:08 devstack cinder-volume[82683]: DEBUG cinder.quota [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Created reservations ['845877b0-f421-4d4a-bafa-eaf457c8eca1', '84835dc0-8b1f-4d07-bd25-8d1ffd639585', '7f8cdc7e-b154-499c-9ed8-1e57d40ccc82', 'ee005568-7273-419f-843a-43724a11a120'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:08 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:08 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:08 devstack sudo[87020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:05:08 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:08 devstack sudo[87001]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.45f22072-2779-45d9-98d5-e8aacc6b6e22" returned: 0 in 0.917s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.45f22072-2779-45d9-98d5-e8aacc6b6e22 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:08 devstack sudo[87037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.45f22072-2779-45d9-98d5-e8aacc6b6e22 Feb 27 02:05:08 devstack sudo[87037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:09 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.857s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:09 devstack cinder-volume[82683]: DEBUG cinder.manager [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:09 devstack cinder-volume[82683]: INFO cinder.volume.manager [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Deleted volume successfully. Feb 27 02:05:09 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-cdf9b84e-6942-450e-bdf1-577012bb3e57 req-d0dffeb8-082c-4d9b-bcc1-0a018e8c78de tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "cinder-9e5a42f9-123a-40b7-81da-2e62b0a0c064-delete_volume" released by "delete_volume" :: held 3.684s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:09 devstack cinder-volume[82683]: DEBUG oslo_service.periodic_task [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:05:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:09 devstack sudo[87043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:05:09 devstack sudo[87043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:09 devstack sudo[87037]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.45f22072-2779-45d9-98d5-e8aacc6b6e22" returned: 0 in 0.751s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:09 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-quobyte-45f22072-2779-45d9-98d5-e8aacc6b6e22" released by "_delete_snapshot" :: held 3.365s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:09 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-quobyte-92d6190f-1348-4e79-bdbf-b7e4f57ac308" released by "delete_snapshot" :: held 3.385s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:09 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] Created reservations ['28dad374-26df-43d3-a7eb-308e6e9960b4', '95dabae3-8aba-4496-869b-363845bdea08', '941b29c9-0255-4f89-a745-1cd3240527cc', '76555310-f59a-4658-ad20-47aafcf878dd'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:09 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] Delete snapshot completed successfully. Feb 27 02:05:09 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-08cfc512-805d-49ff-8151-1504b0b0ebcc tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-45f22072-2779-45d9-98d5-e8aacc6b6e22-delete_snapshot" released by "delete_snapshot" :: held 3.508s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:09 devstack sudo[87043]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.524s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:09 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:10 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:UPDATE=98,cinder:SELECT=112,cinder:INSERT=22,cinder:DELETE=7 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:05:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-00ca69a0-6aa1-4bc2-bb4d-1c22c1f4101a tempest-SnapshotsActionsTest-968393943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-00ca69a0-6aa1-4bc2-bb4d-1c22c1f4101a tempest-SnapshotsActionsTest-968393943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:10 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-00ca69a0-6aa1-4bc2-bb4d-1c22c1f4101a tempest-SnapshotsActionsTest-968393943 None] Creating offline snapshot 110c5cea-baeb-4f6c-9946-600f405e6903 of volume 92d6190f-1348-4e79-bdbf-b7e4f57ac308 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:05:10 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f243ee81-2891-42eb-bcbe-ec73bc4418cb]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-00ca69a0-6aa1-4bc2-bb4d-1c22c1f4101a tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:10 devstack sudo[87067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 Feb 27 02:05:10 devstack sudo[87067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:11 devstack sudo[87067]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-00ca69a0-6aa1-4bc2-bb4d-1c22c1f4101a tempest-SnapshotsActionsTest-968393943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4" returned: 0 in 0.815s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-00ca69a0-6aa1-4bc2-bb4d-1c22c1f4101a tempest-SnapshotsActionsTest-968393943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-00ca69a0-6aa1-4bc2-bb4d-1c22c1f4101a tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.110c5cea-baeb-4f6c-9946-600f405e6903 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:11 devstack sudo[87075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.110c5cea-baeb-4f6c-9946-600f405e6903 1G Feb 27 02:05:11 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:12 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-00ca69a0-6aa1-4bc2-bb4d-1c22c1f4101a tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.110c5cea-baeb-4f6c-9946-600f405e6903 1G" returned: 0 in 0.715s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-00ca69a0-6aa1-4bc2-bb4d-1c22c1f4101a tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.110c5cea-baeb-4f6c-9946-600f405e6903 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:12 devstack sudo[87081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.110c5cea-baeb-4f6c-9946-600f405e6903 Feb 27 02:05:12 devstack sudo[87081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:12 devstack sudo[87081]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-00ca69a0-6aa1-4bc2-bb4d-1c22c1f4101a tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.110c5cea-baeb-4f6c-9946-600f405e6903" returned: 0 in 0.598s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:12 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-00ca69a0-6aa1-4bc2-bb4d-1c22c1f4101a tempest-SnapshotsActionsTest-968393943 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.110c5cea-baeb-4f6c-9946-600f405e6903 is being set with open permissions: ugo+rw Feb 27 02:05:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-00ca69a0-6aa1-4bc2-bb4d-1c22c1f4101a tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.110c5cea-baeb-4f6c-9946-600f405e6903 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:12 devstack sudo[87086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.110c5cea-baeb-4f6c-9946-600f405e6903 Feb 27 02:05:12 devstack sudo[87086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:13 devstack sudo[87086]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-00ca69a0-6aa1-4bc2-bb4d-1c22c1f4101a tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.110c5cea-baeb-4f6c-9946-600f405e6903" returned: 0 in 0.625s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:13 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:SELECT=105,cinder:INSERT=41,cinder:UPDATE=111,cinder:DELETE=7 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:05:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-00ca69a0-6aa1-4bc2-bb4d-1c22c1f4101a tempest-SnapshotsActionsTest-968393943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.842s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:13 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-00ca69a0-6aa1-4bc2-bb4d-1c22c1f4101a tempest-SnapshotsActionsTest-968393943 None] Create snapshot completed successfully Feb 27 02:05:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] Acquiring lock "cinder-110c5cea-baeb-4f6c-9946-600f405e6903-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-110c5cea-baeb-4f6c-9946-600f405e6903-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] Acquiring lock "cinder-quobyte-92d6190f-1348-4e79-bdbf-b7e4f57ac308" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-quobyte-92d6190f-1348-4e79-bdbf-b7e4f57ac308" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] Acquiring lock "cinder-quobyte-110c5cea-baeb-4f6c-9946-600f405e6903" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-quobyte-110c5cea-baeb-4f6c-9946-600f405e6903" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] Deleting offline snapshot 110c5cea-baeb-4f6c-9946-600f405e6903 of volume 92d6190f-1348-4e79-bdbf-b7e4f57ac308 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:05:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] snapshot_file for this snap is: volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.110c5cea-baeb-4f6c-9946-600f405e6903 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:05:13 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e55d2a-4510-49f8-9b2c-de9e0f34cbed]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.110c5cea-baeb-4f6c-9946-600f405e6903 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:13 devstack sudo[87089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.110c5cea-baeb-4f6c-9946-600f405e6903 Feb 27 02:05:13 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:14 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.110c5cea-baeb-4f6c-9946-600f405e6903" returned: 0 in 0.922s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:14 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdcaf4e-54e5-4ab9-aaeb-00fcfccb7d09]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:14 devstack sudo[87094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 Feb 27 02:05:14 devstack sudo[87094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:15 devstack sudo[87094]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4" returned: 0 in 0.675s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:15 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.110c5cea-baeb-4f6c-9946-600f405e6903 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:15 devstack sudo[87099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.110c5cea-baeb-4f6c-9946-600f405e6903 Feb 27 02:05:15 devstack sudo[87099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:16 devstack sudo[87099]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.110c5cea-baeb-4f6c-9946-600f405e6903" returned: 0 in 0.786s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.110c5cea-baeb-4f6c-9946-600f405e6903 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:16 devstack sudo[87104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.110c5cea-baeb-4f6c-9946-600f405e6903 Feb 27 02:05:16 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Flow 'volume_create_manager' (64143dfa-346a-45cd-8d26-4917b11ba23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fa19baf-4e87-4749-9830-4666c3850f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fa19baf-4e87-4749-9830-4666c3850f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-660128493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8ab80e-ced4-466e-9455-7374e046c4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5d4f6c3a96462fb3fda3f1839254b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:16Z,use_quota=True,user_id='d30c3b6d363b4b939a3abed814b31de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f00886-bfc9-4949-b978-f900c0cc6926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f00886-bfc9-4949-b978-f900c0cc6926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e05c00-6635-48bf-9887-1eb869852572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e05c00-6635-48bf-9887-1eb869852572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f8ab80e-ced4-466e-9455-7374e046c4fb', 'volume_name': 'volume-4f8ab80e-ced4-466e-9455-7374e046c4fb', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c103a69d-bc7a-4225-8812-efd9c9143623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c103a69d-bc7a-4225-8812-efd9c9143623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f51531-9aa3-44fe-bd4a-e3483762e891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:16 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Volume 4f8ab80e-ced4-466e-9455-7374e046c4fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f8ab80e-ced4-466e-9455-7374e046c4fb', 'volume_size': 1} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-660128493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8ab80e-ced4-466e-9455-7374e046c4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5d4f6c3a96462fb3fda3f1839254b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:16Z,use_quota=True,user_id='d30c3b6d363b4b939a3abed814b31de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Creating volume 4f8ab80e-ced4-466e-9455-7374e046c4fb {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:16 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4f8ab80e-ced4-466e-9455-7374e046c4fb 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c7b5d9c4-f5f8-4a01-8154-4bcb491a0708 tempest-VolumesActionsTest-682815822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:16 devstack sudo[87106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4f8ab80e-ced4-466e-9455-7374e046c4fb 1073741824 Feb 27 02:05:16 devstack sudo[87106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:16 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.110c5cea-baeb-4f6c-9946-600f405e6903" returned: 0 in 0.608s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-quobyte-110c5cea-baeb-4f6c-9946-600f405e6903" released by "_delete_snapshot" :: held 3.103s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:16 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-quobyte-92d6190f-1348-4e79-bdbf-b7e4f57ac308" released by "delete_snapshot" :: held 3.124s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:17 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] Created reservations ['468ed104-8226-45ac-a184-65b2c60c500b', '24cbc1d4-b7e0-4db4-a8a2-59fd73a8f194', 'cdcf82ce-02fd-4223-bdc2-bc57675f6069', '68969992-07ea-4d5f-a4a6-e423f0315fdf'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:17 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] Delete snapshot completed successfully. Feb 27 02:05:17 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0bb742a4-6e16-421a-bde3-72408d9dda22 tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-110c5cea-baeb-4f6c-9946-600f405e6903-delete_snapshot" released by "delete_snapshot" :: held 3.281s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:17 devstack sudo[87106]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4f8ab80e-ced4-466e-9455-7374e046c4fb 1073741824" returned: 0 in 0.873s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4f8ab80e-ced4-466e-9455-7374e046c4fb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:17 devstack sudo[87136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4f8ab80e-ced4-466e-9455-7374e046c4fb Feb 27 02:05:17 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e5d89d9b-7d69-437a-a993-f93416b225a4 tempest-SnapshotsActionsTest-968393943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:18 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4f8ab80e-ced4-466e-9455-7374e046c4fb" returned: 0 in 0.517s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:18 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c7b5d9c4-f5f8-4a01-8154-4bcb491a0708 tempest-VolumesActionsTest-682815822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.409s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:18 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f51531-9aa3-44fe-bd4a-e3483762e891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f8ab80e-ced4-466e-9455-7374e046c4fb', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:18 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc56faa-9cc2-4564-91d9-1e398dd17173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:18 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98c67a1-a733-4c8f-bca5-ec1eff2e5458]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c7b5d9c4-f5f8-4a01-8154-4bcb491a0708 tempest-VolumesActionsTest-682815822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:18 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Volume volume-4f8ab80e-ced4-466e-9455-7374e046c4fb (4f8ab80e-ced4-466e-9455-7374e046c4fb): created successfully Feb 27 02:05:18 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc56faa-9cc2-4564-91d9-1e398dd17173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:18 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Flow 'volume_create_manager' (64143dfa-346a-45cd-8d26-4917b11ba23c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:18 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-f751702b-32b9-4edf-bf26-49cd22ded87a tempest-AbsoluteLimitsTests-1590312678 None] Created volume successfully. Feb 27 02:05:18 devstack sudo[87140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 Feb 27 02:05:18 devstack sudo[87140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:18 devstack sudo[87140]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c7b5d9c4-f5f8-4a01-8154-4bcb491a0708 tempest-VolumesActionsTest-682815822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45" returned: 0 in 0.625s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:18 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[37598157-35e6-4da6-b60c-12ebf5bdba1a]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c7b5d9c4-f5f8-4a01-8154-4bcb491a0708 tempest-VolumesActionsTest-682815822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:18 devstack sudo[87146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 Feb 27 02:05:18 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bd7b75a9-5a1b-4ff1-afaf-7ed4f6af61ab tempest-AbsoluteLimitsTests-1590312678 None] Acquiring lock "cinder-4f8ab80e-ced4-466e-9455-7374e046c4fb-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bd7b75a9-5a1b-4ff1-afaf-7ed4f6af61ab tempest-AbsoluteLimitsTests-1590312678 None] Lock "cinder-4f8ab80e-ced4-466e-9455-7374e046c4fb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bd7b75a9-5a1b-4ff1-afaf-7ed4f6af61ab tempest-AbsoluteLimitsTests-1590312678 None] Acquiring lock "cinder-quobyte-4f8ab80e-ced4-466e-9455-7374e046c4fb" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bd7b75a9-5a1b-4ff1-afaf-7ed4f6af61ab tempest-AbsoluteLimitsTests-1590312678 None] Lock "cinder-quobyte-4f8ab80e-ced4-466e-9455-7374e046c4fb" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:18 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[48619b63-5995-41dd-b44e-c7f9223dfa94]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bd7b75a9-5a1b-4ff1-afaf-7ed4f6af61ab tempest-AbsoluteLimitsTests-1590312678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4f8ab80e-ced4-466e-9455-7374e046c4fb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:19 devstack sudo[87149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4f8ab80e-ced4-466e-9455-7374e046c4fb Feb 27 02:05:19 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:19 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c7b5d9c4-f5f8-4a01-8154-4bcb491a0708 tempest-VolumesActionsTest-682815822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45" returned: 0 in 0.581s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c7b5d9c4-f5f8-4a01-8154-4bcb491a0708 tempest-VolumesActionsTest-682815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 /opt/stack/data/cinder/conversion/1110b59b-04c5-4975-9085-1a24ae4fdf45.temp_image.5067918e-ba27-4c1c-923d-3121d48906b75lgxn_vk.img {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:19 devstack sudo[87154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 /opt/stack/data/cinder/conversion/1110b59b-04c5-4975-9085-1a24ae4fdf45.temp_image.5067918e-ba27-4c1c-923d-3121d48906b75lgxn_vk.img Feb 27 02:05:19 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:19 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bd7b75a9-5a1b-4ff1-afaf-7ed4f6af61ab tempest-AbsoluteLimitsTests-1590312678 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4f8ab80e-ced4-466e-9455-7374e046c4fb" returned: 0 in 0.627s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bd7b75a9-5a1b-4ff1-afaf-7ed4f6af61ab tempest-AbsoluteLimitsTests-1590312678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4f8ab80e-ced4-466e-9455-7374e046c4fb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:19 devstack sudo[87159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4f8ab80e-ced4-466e-9455-7374e046c4fb Feb 27 02:05:19 devstack sudo[87159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:19 devstack cinder-volume[82683]: INFO cinder.volume.manager [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-8f521752-447d-4a28-8bf8-ee97aa5e4d92 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Terminate volume connection completed successfully. Feb 27 02:05:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-8f521752-447d-4a28-8bf8-ee97aa5e4d92 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Deleting attachment b87cc7b4-d308-4afb-bf2f-6182627e4f7f. {{(pid=82683) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 27 02:05:20 devstack sudo[87159]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bd7b75a9-5a1b-4ff1-afaf-7ed4f6af61ab tempest-AbsoluteLimitsTests-1590312678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4f8ab80e-ced4-466e-9455-7374e046c4fb" returned: 0 in 1.002s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:20 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bd7b75a9-5a1b-4ff1-afaf-7ed4f6af61ab tempest-AbsoluteLimitsTests-1590312678 None] Lock "cinder-quobyte-4f8ab80e-ced4-466e-9455-7374e046c4fb" released by "delete_volume" :: held 1.688s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:20 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-bebf6104-5dca-4691-8f1d-499af328a341 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Acquiring lock "cinder-38ec5673-41d0-41b6-94af-b6c1a514675b-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:20 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-bebf6104-5dca-4691-8f1d-499af328a341 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "cinder-38ec5673-41d0-41b6-94af-b6c1a514675b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:20 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-bebf6104-5dca-4691-8f1d-499af328a341 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Acquiring lock "cinder-quobyte-38ec5673-41d0-41b6-94af-b6c1a514675b" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:20 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-bd7b75a9-5a1b-4ff1-afaf-7ed4f6af61ab tempest-AbsoluteLimitsTests-1590312678 None] Created reservations ['a242b3a9-824a-420d-8160-42e845aa8872', '7f5710e8-68a8-446e-a056-ef90b9efd436', '4266e49c-481e-47f8-9677-519f820c2b59', '3b86a080-6631-4bd0-9183-31e4621e007b'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:21 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-bebf6104-5dca-4691-8f1d-499af328a341 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "cinder-quobyte-38ec5673-41d0-41b6-94af-b6c1a514675b" acquired by "delete_volume" :: waited 0.153s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:21 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a167db24-1670-402b-bad8-2a70a787e4d5]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-bebf6104-5dca-4691-8f1d-499af328a341 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38ec5673-41d0-41b6-94af-b6c1a514675b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bd7b75a9-5a1b-4ff1-afaf-7ed4f6af61ab tempest-AbsoluteLimitsTests-1590312678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bd7b75a9-5a1b-4ff1-afaf-7ed4f6af61ab tempest-AbsoluteLimitsTests-1590312678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:21 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-bd7b75a9-5a1b-4ff1-afaf-7ed4f6af61ab tempest-AbsoluteLimitsTests-1590312678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:21 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-bd7b75a9-5a1b-4ff1-afaf-7ed4f6af61ab tempest-AbsoluteLimitsTests-1590312678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bd7b75a9-5a1b-4ff1-afaf-7ed4f6af61ab tempest-AbsoluteLimitsTests-1590312678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bd7b75a9-5a1b-4ff1-afaf-7ed4f6af61ab tempest-AbsoluteLimitsTests-1590312678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:21 devstack sudo[87180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:05:21 devstack sudo[87180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:21 devstack sudo[87179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38ec5673-41d0-41b6-94af-b6c1a514675b Feb 27 02:05:21 devstack sudo[87179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:22 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c7b5d9c4-f5f8-4a01-8154-4bcb491a0708 tempest-VolumesActionsTest-682815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 /opt/stack/data/cinder/conversion/1110b59b-04c5-4975-9085-1a24ae4fdf45.temp_image.5067918e-ba27-4c1c-923d-3121d48906b75lgxn_vk.img" returned: 0 in 2.837s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:22 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd556f7-fbe1-4bed-a8ef-9c1f5a0a0aab]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c7b5d9c4-f5f8-4a01-8154-4bcb491a0708 tempest-VolumesActionsTest-682815822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:22 devstack sudo[87179]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-bebf6104-5dca-4691-8f1d-499af328a341 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38ec5673-41d0-41b6-94af-b6c1a514675b" returned: 0 in 1.208s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-bebf6104-5dca-4691-8f1d-499af328a341 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38ec5673-41d0-41b6-94af-b6c1a514675b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:22 devstack sudo[87187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38ec5673-41d0-41b6-94af-b6c1a514675b Feb 27 02:05:22 devstack sudo[87187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:22 devstack sudo[87185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 Feb 27 02:05:22 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:22 devstack sudo[87180]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bd7b75a9-5a1b-4ff1-afaf-7ed4f6af61ab tempest-AbsoluteLimitsTests-1590312678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 1.325s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:22 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-bd7b75a9-5a1b-4ff1-afaf-7ed4f6af61ab tempest-AbsoluteLimitsTests-1590312678 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:22 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-bd7b75a9-5a1b-4ff1-afaf-7ed4f6af61ab tempest-AbsoluteLimitsTests-1590312678 None] Deleted volume successfully. Feb 27 02:05:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bd7b75a9-5a1b-4ff1-afaf-7ed4f6af61ab tempest-AbsoluteLimitsTests-1590312678 None] Lock "cinder-4f8ab80e-ced4-466e-9455-7374e046c4fb-delete_volume" released by "delete_volume" :: held 3.643s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:22 devstack sudo[87187]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-bebf6104-5dca-4691-8f1d-499af328a341 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38ec5673-41d0-41b6-94af-b6c1a514675b" returned: 0 in 0.600s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-bebf6104-5dca-4691-8f1d-499af328a341 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "cinder-quobyte-38ec5673-41d0-41b6-94af-b6c1a514675b" released by "delete_volume" :: held 1.848s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:22 devstack cinder-volume[82683]: DEBUG cinder.quota [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-bebf6104-5dca-4691-8f1d-499af328a341 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Created reservations ['73bc8526-a96c-4c60-a07e-cd6a7ab9a71c', '762a6511-6f35-41da-8968-8643c0d17e24', '0eb5d824-682a-47ea-b47a-f0dc369d789e', '162ef6b2-212a-4b0f-b8a6-053ba432ef0e'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-bebf6104-5dca-4691-8f1d-499af328a341 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-bebf6104-5dca-4691-8f1d-499af328a341 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-bebf6104-5dca-4691-8f1d-499af328a341 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-bebf6104-5dca-4691-8f1d-499af328a341 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-bebf6104-5dca-4691-8f1d-499af328a341 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-bebf6104-5dca-4691-8f1d-499af328a341 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:22 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c7b5d9c4-f5f8-4a01-8154-4bcb491a0708 tempest-VolumesActionsTest-682815822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45" returned: 0 in 0.849s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:23 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-c7b5d9c4-f5f8-4a01-8154-4bcb491a0708 tempest-VolumesActionsTest-682815822 None] Image conversion details: src /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45, size 1024.00 MB, duration 2.84 sec, destination /opt/stack/data/cinder/conversion/1110b59b-04c5-4975-9085-1a24ae4fdf45.temp_image.5067918e-ba27-4c1c-923d-3121d48906b75lgxn_vk.img {{(pid=82683) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:05:23 devstack cinder-volume[82683]: INFO cinder.image.image_utils [None req-c7b5d9c4-f5f8-4a01-8154-4bcb491a0708 tempest-VolumesActionsTest-682815822 None] Converted 1024.00 MB image at 360.60 MB/s Feb 27 02:05:23 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-c7b5d9c4-f5f8-4a01-8154-4bcb491a0708 tempest-VolumesActionsTest-682815822 None] 5067918e-ba27-4c1c-923d-3121d48906b7 was raw, no need to convert to raw {{(pid=82683) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Feb 27 02:05:23 devstack sudo[87195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:05:23 devstack sudo[87195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:23 devstack sudo[87195]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-bebf6104-5dca-4691-8f1d-499af328a341 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.589s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:23 devstack cinder-volume[82683]: DEBUG cinder.manager [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-bebf6104-5dca-4691-8f1d-499af328a341 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:23 devstack cinder-volume[82683]: INFO cinder.volume.manager [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-bebf6104-5dca-4691-8f1d-499af328a341 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Deleted volume successfully. Feb 27 02:05:23 devstack cinder-volume[82683]: DEBUG cinder.coordination [req-995a5bce-0d24-459f-b808-aae7abaddaf6 req-bebf6104-5dca-4691-8f1d-499af328a341 tempest-ServerBootFromVolumeStableRescueTest-62742235 None] Lock "cinder-38ec5673-41d0-41b6-94af-b6c1a514675b-delete_volume" released by "delete_volume" :: held 2.816s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:25 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Flow 'volume_create_manager' (e5319fd5-116c-4984-bc7e-09fb5e515958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f125a2-1906-4396-8b7c-fc0933262483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f125a2-1906-4396-8b7c-fc0933262483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1729310723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a142e84c-0d66-4aa5-9ce5-8148580f6c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf067f5cea924cb19a14221fa67e3e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:25Z,use_quota=True,user_id='655ae897e8c34e58870eb6788aad1db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f1936d6-0491-4711-8af5-e868cf4943f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f1936d6-0491-4711-8af5-e868cf4943f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f317e33c-7d1e-417a-9687-5581f209b99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:25 devstack cinder-volume[82683]: DEBUG cinder.image.glance [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Creating Keystone auth plugin from conf {{(pid=82683) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 02:05:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f317e33c-7d1e-417a-9687-5581f209b99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a142e84c-0d66-4aa5-9ce5-8148580f6c25', 'volume_name': 'volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25', 'volume_size': 1, 'image_id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '757f43b353254b8d946a078a47db0c70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1936e0bd-39f5-48aa-82e1-d79c80c86062/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40fff1b7-a063-441d-a25a-a6efe16bf3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40fff1b7-a063-441d-a25a-a6efe16bf3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1985a2e9-696e-48a9-8f22-664a9236e67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:25 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Volume a142e84c-0d66-4aa5-9ce5-8148580f6c25: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25', 'volume_size': 1, 'image_id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '757f43b353254b8d946a078a47db0c70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1936e0bd-39f5-48aa-82e1-d79c80c86062/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 02:05:25 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Trying to clone a142e84c-0d66-4aa5-9ce5-8148580f6c25 from image 1936e0bd-39f5-48aa-82e1-d79c80c86062 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}]). {{(pid=82683) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 02:05:25 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_r_sdjkuadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82683) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 02:05:25 devstack cinder-volume[82683]: INFO cinder.image.image_utils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Image download 20.69 MB at 20.69 MB/s Feb 27 02:05:26 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[274a27d5-bbff-4981-a3a3-0e61a91467d4]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_r_sdjkuadevstack@QuobyteHD {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:26 devstack sudo[87201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_r_sdjkuadevstack@QuobyteHD Feb 27 02:05:26 devstack sudo[87201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:26 devstack sudo[87201]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_r_sdjkuadevstack@QuobyteHD" returned: 0 in 0.618s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:26 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Temporary image 1936e0bd-39f5-48aa-82e1-d79c80c86062 is fetched for user 655ae897e8c34e58870eb6788aad1db0. {{(pid=82683) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 02:05:26 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6fd889-4789-490f-9d96-03abbe065e4f]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_r_sdjkuadevstack@QuobyteHD {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:27 devstack sudo[87206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_r_sdjkuadevstack@QuobyteHD Feb 27 02:05:27 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:27 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_r_sdjkuadevstack@QuobyteHD" returned: 0 in 0.632s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c7b5d9c4-f5f8-4a01-8154-4bcb491a0708 tempest-VolumesActionsTest-682815822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 17.014s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:35 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-c7b5d9c4-f5f8-4a01-8154-4bcb491a0708 tempest-VolumesActionsTest-682815822 None] Uploaded volume to glance image-id: 5067918e-ba27-4c1c-923d-3121d48906b7. {{(pid=82683) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 27 02:05:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e5d89d9b-7d69-437a-a993-f93416b225a4 tempest-SnapshotsActionsTest-968393943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 17.242s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:35 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-c7b5d9c4-f5f8-4a01-8154-4bcb491a0708 tempest-VolumesActionsTest-682815822 None] Copy volume to image completed successfully. Feb 27 02:05:35 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-e5d89d9b-7d69-437a-a993-f93416b225a4 tempest-SnapshotsActionsTest-968393943 None] Creating offline snapshot 000498fe-2330-4c0c-9ba1-2081c75f10f2 of volume 92d6190f-1348-4e79-bdbf-b7e4f57ac308 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:05:35 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[783b78d0-c790-4671-a686-61d46bd44a0a]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e5d89d9b-7d69-437a-a993-f93416b225a4 tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:35 devstack sudo[87238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 Feb 27 02:05:35 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:35 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e5d89d9b-7d69-437a-a993-f93416b225a4 tempest-SnapshotsActionsTest-968393943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4" returned: 0 in 0.631s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:35 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-e5d89d9b-7d69-437a-a993-f93416b225a4 tempest-SnapshotsActionsTest-968393943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e5d89d9b-7d69-437a-a993-f93416b225a4 tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.000498fe-2330-4c0c-9ba1-2081c75f10f2 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:35 devstack sudo[87244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.000498fe-2330-4c0c-9ba1-2081c75f10f2 1G Feb 27 02:05:35 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:36 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e5d89d9b-7d69-437a-a993-f93416b225a4 tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.000498fe-2330-4c0c-9ba1-2081c75f10f2 1G" returned: 0 in 0.669s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e5d89d9b-7d69-437a-a993-f93416b225a4 tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.000498fe-2330-4c0c-9ba1-2081c75f10f2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:36 devstack sudo[87249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.000498fe-2330-4c0c-9ba1-2081c75f10f2 Feb 27 02:05:36 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:37 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e5d89d9b-7d69-437a-a993-f93416b225a4 tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.000498fe-2330-4c0c-9ba1-2081c75f10f2" returned: 0 in 0.616s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:37 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-e5d89d9b-7d69-437a-a993-f93416b225a4 tempest-SnapshotsActionsTest-968393943 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.000498fe-2330-4c0c-9ba1-2081c75f10f2 is being set with open permissions: ugo+rw Feb 27 02:05:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e5d89d9b-7d69-437a-a993-f93416b225a4 tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.000498fe-2330-4c0c-9ba1-2081c75f10f2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:37 devstack sudo[87255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.000498fe-2330-4c0c-9ba1-2081c75f10f2 Feb 27 02:05:37 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:37 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e5d89d9b-7d69-437a-a993-f93416b225a4 tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.000498fe-2330-4c0c-9ba1-2081c75f10f2" returned: 0 in 0.579s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e5d89d9b-7d69-437a-a993-f93416b225a4 tempest-SnapshotsActionsTest-968393943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.578s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.088s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:37 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1729310723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a142e84c-0d66-4aa5-9ce5-8148580f6c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf067f5cea924cb19a14221fa67e3e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:25Z,use_quota=True,user_id='655ae897e8c34e58870eb6788aad1db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:37 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Creating volume a142e84c-0d66-4aa5-9ce5-8148580f6c25 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:37 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:37 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:37 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:37 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:05:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:37 devstack sudo[87259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 1073741824 Feb 27 02:05:37 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:37 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-e5d89d9b-7d69-437a-a993-f93416b225a4 tempest-SnapshotsActionsTest-968393943 None] Create snapshot completed successfully Feb 27 02:05:38 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 1073741824" returned: 0 in 0.619s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:38 devstack sudo[87265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 Feb 27 02:05:38 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] Acquiring lock "cinder-000498fe-2330-4c0c-9ba1-2081c75f10f2-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-000498fe-2330-4c0c-9ba1-2081c75f10f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] Acquiring lock "cinder-quobyte-92d6190f-1348-4e79-bdbf-b7e4f57ac308" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-quobyte-92d6190f-1348-4e79-bdbf-b7e4f57ac308" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] Acquiring lock "cinder-quobyte-000498fe-2330-4c0c-9ba1-2081c75f10f2" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-quobyte-000498fe-2330-4c0c-9ba1-2081c75f10f2" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] Deleting offline snapshot 000498fe-2330-4c0c-9ba1-2081c75f10f2 of volume 92d6190f-1348-4e79-bdbf-b7e4f57ac308 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:05:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] snapshot_file for this snap is: volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.000498fe-2330-4c0c-9ba1-2081c75f10f2 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:05:38 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8584f95-0a81-475b-b522-b2c8c2fa5047]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.000498fe-2330-4c0c-9ba1-2081c75f10f2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:38 devstack sudo[87267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.000498fe-2330-4c0c-9ba1-2081c75f10f2 Feb 27 02:05:38 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:38 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25" returned: 0 in 0.529s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.826s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:38 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[791f150e-dcc8-4ae0-978d-7dbacbc380a6]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:38 devstack cinder-volume[82683]: DEBUG cinder.volume.volume_utils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Attempting download of 1936e0bd-39f5-48aa-82e1-d79c80c86062 ((None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}])) to volume a142e84c-0d66-4aa5-9ce5-8148580f6c25. {{(pid=82683) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 02:05:38 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd59ef0-a66e-4777-964f-d23daf9ec52f]: (4, 'raw') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_m969dtjl {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:38 devstack sudo[87270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 Feb 27 02:05:38 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:39 devstack sudo[87271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_m969dtjl Feb 27 02:05:39 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:39 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.000498fe-2330-4c0c-9ba1-2081c75f10f2" returned: 0 in 0.559s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:39 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:39 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd027bd-90f4-40fe-9832-afdaf70c419a]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:39 devstack sudo[87277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 Feb 27 02:05:39 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:39 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45" returned: 0 in 0.639s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:39 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d0c909-a866-48cd-be22-cd69bd645524]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:39 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_m969dtjl" returned: 0 in 0.668s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_m969dtjl {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:39 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 Feb 27 02:05:39 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:39 devstack sudo[87285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_m969dtjl Feb 27 02:05:39 devstack sudo[87285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:39 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4" returned: 0 in 0.547s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:39 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.000498fe-2330-4c0c-9ba1-2081c75f10f2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:39 devstack sudo[87291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.000498fe-2330-4c0c-9ba1-2081c75f10f2 Feb 27 02:05:39 devstack sudo[87291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:40 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45" returned: 0 in 0.565s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 /opt/stack/data/cinder/conversion/1110b59b-04c5-4975-9085-1a24ae4fdf45.temp_image.589f4584-0068-4f0f-9c8a-8200125a2d3dfq1wq8zh.img {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:40 devstack sudo[87298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 /opt/stack/data/cinder/conversion/1110b59b-04c5-4975-9085-1a24ae4fdf45.temp_image.589f4584-0068-4f0f-9c8a-8200125a2d3dfq1wq8zh.img Feb 27 02:05:40 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:40 devstack sudo[87285]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_m969dtjl" returned: 1 in 0.540s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_m969dtjl' failed. Not Retrying. {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:05:40 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3959478-5909-43af-93f7-980bf4379b10]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_r_sdjkuadevstack@QuobyteHD {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:40 devstack sudo[87300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_r_sdjkuadevstack@QuobyteHD Feb 27 02:05:40 devstack sudo[87300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:40 devstack sudo[87291]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.000498fe-2330-4c0c-9ba1-2081c75f10f2" returned: 0 in 0.614s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.000498fe-2330-4c0c-9ba1-2081c75f10f2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:40 devstack sudo[87306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.000498fe-2330-4c0c-9ba1-2081c75f10f2 Feb 27 02:05:40 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:41 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-a48caaa7-7a01-4ef0-b289-188cf165d600 tempest-GroupsTest-1201261350 None] Group tempest-Group1-674637586: creating Feb 27 02:05:41 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-a48caaa7-7a01-4ef0-b289-188cf165d600 tempest-GroupsTest-1201261350 None] Group tempest-Group1-674637586: created successfully Feb 27 02:05:41 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-a48caaa7-7a01-4ef0-b289-188cf165d600 tempest-GroupsTest-1201261350 None] Create group completed successfully. Feb 27 02:05:41 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.000498fe-2330-4c0c-9ba1-2081c75f10f2" returned: 0 in 1.099s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-quobyte-000498fe-2330-4c0c-9ba1-2081c75f10f2" released by "_delete_snapshot" :: held 2.904s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-quobyte-92d6190f-1348-4e79-bdbf-b7e4f57ac308" released by "delete_snapshot" :: held 2.927s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:41 devstack sudo[87300]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_r_sdjkuadevstack@QuobyteHD" returned: 0 in 1.508s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:41 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] 1936e0bd-39f5-48aa-82e1-d79c80c86062 was qcow2, converting to raw {{(pid=82683) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 02:05:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_r_sdjkuadevstack@QuobyteHD /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:41 devstack sudo[87323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_r_sdjkuadevstack@QuobyteHD /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 Feb 27 02:05:41 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:41 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] Created reservations ['4b16141a-349b-45d5-a7a5-fa7cdb73134e', 'af8e20ea-d5a8-456b-b820-94969d4bbae5', 'e7035388-c6a7-4e6f-8ec0-cf9fde43595d', '59387ed5-9f18-4834-a15c-d9c87b7f88b2'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:41 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] Delete snapshot completed successfully. Feb 27 02:05:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b4851c4e-2d70-4e7c-941f-f04b53c9fe1f tempest-SnapshotsActionsTest-82409397 None] Lock "cinder-000498fe-2330-4c0c-9ba1-2081c75f10f2-delete_snapshot" released by "delete_snapshot" :: held 3.202s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:42 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-fc91b568-0523-4e3d-82e2-0d4a67e29194 tempest-GroupsTest-1201261350 None] Group tempest-Group2-813654736: creating Feb 27 02:05:42 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-fc91b568-0523-4e3d-82e2-0d4a67e29194 tempest-GroupsTest-1201261350 None] Group tempest-Group2-813654736: created successfully Feb 27 02:05:42 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-fc91b568-0523-4e3d-82e2-0d4a67e29194 tempest-GroupsTest-1201261350 None] Create group completed successfully. Feb 27 02:05:42 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 /opt/stack/data/cinder/conversion/1110b59b-04c5-4975-9085-1a24ae4fdf45.temp_image.589f4584-0068-4f0f-9c8a-8200125a2d3dfq1wq8zh.img" returned: 0 in 2.626s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:42 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e79c4c9-fed9-4cd0-b05a-4359485bd248]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:42 devstack sudo[87338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 Feb 27 02:05:42 devstack sudo[87338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:43 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_r_sdjkuadevstack@QuobyteHD /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25" returned: 0 in 1.555s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:43 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_r_sdjkuadevstack@QuobyteHD, size 112.00 MB, duration 1.56 sec, destination /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 {{(pid=82683) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:05:43 devstack cinder-volume[82683]: INFO cinder.image.image_utils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Converted 112.00 MB image at 71.91 MB/s Feb 27 02:05:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:43 devstack sudo[87340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 1G Feb 27 02:05:43 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:43 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] Acquiring lock "cinder-3fb64899-538d-4a85-bb8e-5be37288bac4-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:43 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] Lock "cinder-3fb64899-538d-4a85-bb8e-5be37288bac4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:43 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] Acquiring lock "cinder-quobyte-92d6190f-1348-4e79-bdbf-b7e4f57ac308" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:43 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] Lock "cinder-quobyte-92d6190f-1348-4e79-bdbf-b7e4f57ac308" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:43 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] Acquiring lock "cinder-quobyte-3fb64899-538d-4a85-bb8e-5be37288bac4" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:43 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] Lock "cinder-quobyte-3fb64899-538d-4a85-bb8e-5be37288bac4" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:43 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] Deleting offline snapshot 3fb64899-538d-4a85-bb8e-5be37288bac4 of volume 92d6190f-1348-4e79-bdbf-b7e4f57ac308 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:05:43 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] snapshot_file for this snap is: volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:05:43 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfea195-0c88-40b0-b261-d9b10ea20438]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:43 devstack sudo[87344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 Feb 27 02:05:43 devstack sudo[87344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:43 devstack sudo[87338]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45" returned: 0 in 0.906s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:43 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] Image conversion details: src /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45, size 1024.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/conversion/1110b59b-04c5-4975-9085-1a24ae4fdf45.temp_image.589f4584-0068-4f0f-9c8a-8200125a2d3dfq1wq8zh.img {{(pid=82683) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:05:43 devstack cinder-volume[82683]: INFO cinder.image.image_utils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] Converted 1024.00 MB image at 389.83 MB/s Feb 27 02:05:43 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] 589f4584-0068-4f0f-9c8a-8200125a2d3d was raw, converting to qcow2 {{(pid=82683) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Feb 27 02:05:43 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2338dd-a469-4a9a-a30d-d45b1bfa5382]: (4, 'raw') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1110b59b-04c5-4975-9085-1a24ae4fdf45.temp_image.589f4584-0068-4f0f-9c8a-8200125a2d3dfq1wq8zh.img {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:43 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 1G" returned: 0 in 0.531s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:43 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[048c4546-a76f-4750-8a03-8ef4707ebe47]: (4, 'raw') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:43 devstack sudo[87350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1110b59b-04c5-4975-9085-1a24ae4fdf45.temp_image.589f4584-0068-4f0f-9c8a-8200125a2d3dfq1wq8zh.img Feb 27 02:05:43 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:43 devstack sudo[87351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 Feb 27 02:05:43 devstack sudo[87351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:44 devstack sudo[87344]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4" returned: 0 in 0.610s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cbf1f8-b80a-4fa1-ae35-d484a9150b0f]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Flow 'volume_create_manager' (3d782a98-8e72-412b-a0a7-a10d79853fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51f1500-fad4-4c19-8997-ba8d998e4afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51f1500-fad4-4c19-8997-ba8d998e4afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1085769566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f8dff33-0075-4200-94ec-dd1ab5b74daa,host='devstack@QuobyteHD#QuobyteHD',id=cdaf0bb9-0701-4464-a985-4f3745ac7e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08641c6543ab4b94a02b89f7bd8045e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:44Z,use_quota=True,user_id='44dba7cf884b48a58a98fcac334a1e69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58dfaae9-379a-4a5b-92c5-999994442ca6),volume_type_id=58dfaae9-379a-4a5b-92c5-999994442ca6)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7f6a86-c93e-4bfa-9336-500e5f4cb10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7f6a86-c93e-4bfa-9336-500e5f4cb10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd41ed6-72d8-4b31-a4e1-31fe6ccfd48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd41ed6-72d8-4b31-a4e1-31fe6ccfd48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdaf0bb9-0701-4464-a985-4f3745ac7e04', 'volume_name': 'volume-cdaf0bb9-0701-4464-a985-4f3745ac7e04', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612bffdf-6f56-42f7-bbba-044e09155c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612bffdf-6f56-42f7-bbba-044e09155c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e9e139-a3a6-4bac-a5d5-cf4da900f383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:44 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Volume cdaf0bb9-0701-4464-a985-4f3745ac7e04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdaf0bb9-0701-4464-a985-4f3745ac7e04', 'volume_size': 1} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:44 devstack sudo[87357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308 Feb 27 02:05:44 devstack sudo[87357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:44 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1110b59b-04c5-4975-9085-1a24ae4fdf45.temp_image.589f4584-0068-4f0f-9c8a-8200125a2d3dfq1wq8zh.img" returned: 0 in 0.620s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1110b59b-04c5-4975-9085-1a24ae4fdf45.temp_image.589f4584-0068-4f0f-9c8a-8200125a2d3dfq1wq8zh.img {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:44 devstack sudo[87351]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25" returned: 0 in 0.539s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:44 devstack sudo[87363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1110b59b-04c5-4975-9085-1a24ae4fdf45.temp_image.589f4584-0068-4f0f-9c8a-8200125a2d3dfq1wq8zh.img Feb 27 02:05:44 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:44 devstack sudo[87364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 Feb 27 02:05:44 devstack sudo[87364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:44 devstack sudo[87357]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308" returned: 0 in 0.549s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:44 devstack sudo[87370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 Feb 27 02:05:44 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:44 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1110b59b-04c5-4975-9085-1a24ae4fdf45.temp_image.589f4584-0068-4f0f-9c8a-8200125a2d3dfq1wq8zh.img" returned: 1 in 0.534s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1110b59b-04c5-4975-9085-1a24ae4fdf45.temp_image.589f4584-0068-4f0f-9c8a-8200125a2d3dfq1wq8zh.img' failed. Not Retrying. {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1110b59b-04c5-4975-9085-1a24ae4fdf45.temp_image.589f4584-0068-4f0f-9c8a-8200125a2d3dfq1wq8zh.img /opt/stack/data/cinder/conversion/vol_upload_9lrkizxj {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:44 devstack sudo[87378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1110b59b-04c5-4975-9085-1a24ae4fdf45.temp_image.589f4584-0068-4f0f-9c8a-8200125a2d3dfq1wq8zh.img /opt/stack/data/cinder/conversion/vol_upload_9lrkizxj Feb 27 02:05:44 devstack sudo[87378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:44 devstack sudo[87364]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25" returned: 1 in 0.555s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25' failed. Not Retrying. {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG cinder.volume.volume_utils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Downloaded image 1936e0bd-39f5-48aa-82e1-d79c80c86062 ((None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}])) to volume a142e84c-0d66-4aa5-9ce5-8148580f6c25 successfully. {{(pid=82683) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Temporary image 1936e0bd-39f5-48aa-82e1-d79c80c86062 for user 655ae897e8c34e58870eb6788aad1db0 is deleted. {{(pid=82683) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG cinder.volume.volume_utils [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Marking volume a142e84c-0d66-4aa5-9ce5-8148580f6c25 as bootable. {{(pid=82683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Copying metadata from image 1936e0bd-39f5-48aa-82e1-d79c80c86062 to a142e84c-0d66-4aa5-9ce5-8148580f6c25. {{(pid=82683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Creating volume glance metadata for volume a142e84c-0d66-4aa5-9ce5-8148580f6c25 backed by image 1936e0bd-39f5-48aa-82e1-d79c80c86062 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82683) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1985a2e9-696e-48a9-8f22-664a9236e67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25', 'volume_size': 1, 'image_id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '757f43b353254b8d946a078a47db0c70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1936e0bd-39f5-48aa-82e1-d79c80c86062/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9fad99-951a-448f-9ebe-038214f257d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:44 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Volume volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 (a142e84c-0d66-4aa5-9ce5-8148580f6c25): created successfully Feb 27 02:05:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9fad99-951a-448f-9ebe-038214f257d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Flow 'volume_create_manager' (e5319fd5-116c-4984-bc7e-09fb5e515958) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:45 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-4b18c507-87ed-40bb-ab0a-bd233367546c tempest-VolumesExtendTest-407232047 None] Created volume successfully. Feb 27 02:05:45 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4" returned: 0 in 0.461s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:45 devstack sudo[87383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4 Feb 27 02:05:45 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:45 devstack sudo[87378]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1110b59b-04c5-4975-9085-1a24ae4fdf45.temp_image.589f4584-0068-4f0f-9c8a-8200125a2d3dfq1wq8zh.img /opt/stack/data/cinder/conversion/vol_upload_9lrkizxj" returned: 0 in 0.452s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:45 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] Image conversion details: src /opt/stack/data/cinder/conversion/1110b59b-04c5-4975-9085-1a24ae4fdf45.temp_image.589f4584-0068-4f0f-9c8a-8200125a2d3dfq1wq8zh.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_9lrkizxj {{(pid=82683) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:05:45 devstack cinder-volume[82683]: INFO cinder.image.image_utils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] Converted 1024.00 MB image at 1024.00 MB/s Feb 27 02:05:45 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb05b36-a5d3-4ac8-a760-5a263a40a405]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9lrkizxj {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:45 devstack sudo[87388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9lrkizxj Feb 27 02:05:45 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:45 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308.3fb64899-538d-4a85-bb8e-5be37288bac4" returned: 0 in 0.462s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:45 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] Lock "cinder-quobyte-3fb64899-538d-4a85-bb8e-5be37288bac4" released by "_delete_snapshot" :: held 2.196s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:45 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] Lock "cinder-quobyte-92d6190f-1348-4e79-bdbf-b7e4f57ac308" released by "delete_snapshot" :: held 2.211s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:45 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] Created reservations ['7ff5ef67-597e-45f7-9a06-6ad583769ec1', 'b7d562f6-b612-4df7-9803-e0e75e3e6fd3', '62f5155c-df0b-48df-8942-241bbf98336c', '33a77022-8f7d-49ac-9d03-35b7f2bd70a4'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:45 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] Delete snapshot completed successfully. Feb 27 02:05:45 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ac69c423-c7f0-463d-a702-ff1cbdebdf52 tempest-SnapshotsActionsTest-968393943 None] Lock "cinder-3fb64899-538d-4a85-bb8e-5be37288bac4-delete_snapshot" released by "delete_snapshot" :: held 2.335s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:45 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9lrkizxj" returned: 0 in 0.533s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f779fa3e-58a5-4762-ab41-df5e06ecae65 tempest-VolumesExtendTest-407232047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:46 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d6835344-7874-4e93-9997-c9b6e0b807de tempest-SnapshotsActionsTest-968393943 None] Acquiring lock "cinder-92d6190f-1348-4e79-bdbf-b7e4f57ac308-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:46 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d6835344-7874-4e93-9997-c9b6e0b807de tempest-SnapshotsActionsTest-968393943 None] Lock "cinder-92d6190f-1348-4e79-bdbf-b7e4f57ac308-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:46 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d6835344-7874-4e93-9997-c9b6e0b807de tempest-SnapshotsActionsTest-968393943 None] Acquiring lock "cinder-quobyte-92d6190f-1348-4e79-bdbf-b7e4f57ac308" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:46 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d6835344-7874-4e93-9997-c9b6e0b807de tempest-SnapshotsActionsTest-968393943 None] Lock "cinder-quobyte-92d6190f-1348-4e79-bdbf-b7e4f57ac308" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:46 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d988808e-6141-499b-869e-7b632d8414a9]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d6835344-7874-4e93-9997-c9b6e0b807de tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:46 devstack sudo[87394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308 Feb 27 02:05:46 devstack sudo[87394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.055s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:46 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] Uploaded volume to glance image-id: 589f4584-0068-4f0f-9c8a-8200125a2d3d. {{(pid=82683) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 27 02:05:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.763s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4f8dff33-0075-4200-94ec-dd1ab5b74daa,created_at=2026-02-27T01:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1085769566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f8dff33-0075-4200-94ec-dd1ab5b74daa,host='devstack@QuobyteHD#QuobyteHD',id=cdaf0bb9-0701-4464-a985-4f3745ac7e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08641c6543ab4b94a02b89f7bd8045e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:44Z,use_quota=True,user_id='44dba7cf884b48a58a98fcac334a1e69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58dfaae9-379a-4a5b-92c5-999994442ca6),volume_type_id=58dfaae9-379a-4a5b-92c5-999994442ca6)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Creating volume cdaf0bb9-0701-4464-a985-4f3745ac7e04 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:46 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:05:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cdaf0bb9-0701-4464-a985-4f3745ac7e04 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:46 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-c085f8e8-2d90-45a8-964a-4b3c95c1b02f tempest-VolumesActionsTest-682815822 None] Copy volume to image completed successfully. Feb 27 02:05:46 devstack sudo[87396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cdaf0bb9-0701-4464-a985-4f3745ac7e04 1073741824 Feb 27 02:05:46 devstack sudo[87396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:47 devstack sudo[87394]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d6835344-7874-4e93-9997-c9b6e0b807de tempest-SnapshotsActionsTest-968393943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308" returned: 0 in 0.655s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d6835344-7874-4e93-9997-c9b6e0b807de tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:47 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308 Feb 27 02:05:47 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:47 devstack sudo[87396]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cdaf0bb9-0701-4464-a985-4f3745ac7e04 1073741824" returned: 0 in 0.632s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cdaf0bb9-0701-4464-a985-4f3745ac7e04 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:47 devstack sudo[87406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cdaf0bb9-0701-4464-a985-4f3745ac7e04 Feb 27 02:05:47 devstack sudo[87406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:47 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d6835344-7874-4e93-9997-c9b6e0b807de tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-92d6190f-1348-4e79-bdbf-b7e4f57ac308" returned: 0 in 0.561s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d6835344-7874-4e93-9997-c9b6e0b807de tempest-SnapshotsActionsTest-968393943 None] Lock "cinder-quobyte-92d6190f-1348-4e79-bdbf-b7e4f57ac308" released by "delete_volume" :: held 1.259s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:47 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-d6835344-7874-4e93-9997-c9b6e0b807de tempest-SnapshotsActionsTest-968393943 None] Created reservations ['5029cdf0-a501-4e2b-86fe-a91b50adfac9', '6a7d2f97-657b-468f-b8e5-8c91e3aa9179', '0ea10f98-4a09-4a42-a20f-34d6c1d44f49', 'e34ac301-861f-479a-a205-a5dc935d1499'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a4dda042-ec67-45c1-9d71-54266c0441e4 tempest-VolumesActionsTest-682815822 None] Acquiring lock "cinder-1110b59b-04c5-4975-9085-1a24ae4fdf45-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a4dda042-ec67-45c1-9d71-54266c0441e4 tempest-VolumesActionsTest-682815822 None] Lock "cinder-1110b59b-04c5-4975-9085-1a24ae4fdf45-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d6835344-7874-4e93-9997-c9b6e0b807de tempest-SnapshotsActionsTest-968393943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d6835344-7874-4e93-9997-c9b6e0b807de tempest-SnapshotsActionsTest-968393943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:47 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d6835344-7874-4e93-9997-c9b6e0b807de tempest-SnapshotsActionsTest-968393943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:47 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d6835344-7874-4e93-9997-c9b6e0b807de tempest-SnapshotsActionsTest-968393943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d6835344-7874-4e93-9997-c9b6e0b807de tempest-SnapshotsActionsTest-968393943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d6835344-7874-4e93-9997-c9b6e0b807de tempest-SnapshotsActionsTest-968393943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:48 devstack sudo[87409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:05:48 devstack sudo[87409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:48 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a4dda042-ec67-45c1-9d71-54266c0441e4 tempest-VolumesActionsTest-682815822 None] Acquiring lock "cinder-quobyte-1110b59b-04c5-4975-9085-1a24ae4fdf45" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:48 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a4dda042-ec67-45c1-9d71-54266c0441e4 tempest-VolumesActionsTest-682815822 None] Lock "cinder-quobyte-1110b59b-04c5-4975-9085-1a24ae4fdf45" acquired by "delete_volume" :: waited 0.016s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:48 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3859d9-9b10-4c40-88bf-bc004edda829]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a4dda042-ec67-45c1-9d71-54266c0441e4 tempest-VolumesActionsTest-682815822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:48 devstack sudo[87411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 Feb 27 02:05:48 devstack sudo[87411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:48 devstack sudo[87406]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cdaf0bb9-0701-4464-a985-4f3745ac7e04" returned: 0 in 0.623s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f779fa3e-58a5-4762-ab41-df5e06ecae65 tempest-VolumesExtendTest-407232047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.241s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e9e139-a3a6-4bac-a5d5-cf4da900f383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdaf0bb9-0701-4464-a985-4f3745ac7e04', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84b604c-0b93-4c13-9f00-ac8bbd59b0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:48 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Volume volume-cdaf0bb9-0701-4464-a985-4f3745ac7e04 (cdaf0bb9-0701-4464-a985-4f3745ac7e04): created successfully Feb 27 02:05:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84b604c-0b93-4c13-9f00-ac8bbd59b0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Flow 'volume_create_manager' (3d782a98-8e72-412b-a0a7-a10d79853fd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:48 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f915a246-67ac-47ad-b31b-7e487728adee]: (4, 'raw') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f779fa3e-58a5-4762-ab41-df5e06ecae65 tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:48 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-6cf99977-b4d7-473e-8213-49aaa90e3155 tempest-GroupsTest-1201261350 None] Created volume successfully. Feb 27 02:05:48 devstack sudo[87415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 Feb 27 02:05:48 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:48 devstack sudo[87409]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d6835344-7874-4e93-9997-c9b6e0b807de tempest-SnapshotsActionsTest-968393943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.527s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:48 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-d6835344-7874-4e93-9997-c9b6e0b807de tempest-SnapshotsActionsTest-968393943 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:48 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-d6835344-7874-4e93-9997-c9b6e0b807de tempest-SnapshotsActionsTest-968393943 None] Deleted volume successfully. Feb 27 02:05:48 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d6835344-7874-4e93-9997-c9b6e0b807de tempest-SnapshotsActionsTest-968393943 None] Lock "cinder-92d6190f-1348-4e79-bdbf-b7e4f57ac308-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:48 devstack sudo[87411]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a4dda042-ec67-45c1-9d71-54266c0441e4 tempest-VolumesActionsTest-682815822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45" returned: 0 in 0.588s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a4dda042-ec67-45c1-9d71-54266c0441e4 tempest-VolumesActionsTest-682815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:48 devstack sudo[87421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45 Feb 27 02:05:48 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:48 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f779fa3e-58a5-4762-ab41-df5e06ecae65 tempest-VolumesExtendTest-407232047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25" returned: 0 in 0.596s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f779fa3e-58a5-4762-ab41-df5e06ecae65 tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:48 devstack sudo[87425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 Feb 27 02:05:48 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:49 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a4dda042-ec67-45c1-9d71-54266c0441e4 tempest-VolumesActionsTest-682815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1110b59b-04c5-4975-9085-1a24ae4fdf45" returned: 0 in 0.510s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:49 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a4dda042-ec67-45c1-9d71-54266c0441e4 tempest-VolumesActionsTest-682815822 None] Lock "cinder-quobyte-1110b59b-04c5-4975-9085-1a24ae4fdf45" released by "delete_volume" :: held 1.129s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:49 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-a4dda042-ec67-45c1-9d71-54266c0441e4 tempest-VolumesActionsTest-682815822 None] Created reservations ['81856245-46c4-459d-a828-8606ad712f8c', '601b5b64-9a77-4bf2-aee7-afbdd0dde2e5', 'd8192b41-e25e-4093-9783-100b2a773a0b', '5f5c3fb2-eb30-49d8-8597-d14aa62b320a'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a4dda042-ec67-45c1-9d71-54266c0441e4 tempest-VolumesActionsTest-682815822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a4dda042-ec67-45c1-9d71-54266c0441e4 tempest-VolumesActionsTest-682815822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a4dda042-ec67-45c1-9d71-54266c0441e4 tempest-VolumesActionsTest-682815822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a4dda042-ec67-45c1-9d71-54266c0441e4 tempest-VolumesActionsTest-682815822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a4dda042-ec67-45c1-9d71-54266c0441e4 tempest-VolumesActionsTest-682815822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a4dda042-ec67-45c1-9d71-54266c0441e4 tempest-VolumesActionsTest-682815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:49 devstack sudo[87428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:05:49 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:49 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f779fa3e-58a5-4762-ab41-df5e06ecae65 tempest-VolumesExtendTest-407232047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25" returned: 1 in 0.685s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f779fa3e-58a5-4762-ab41-df5e06ecae65 tempest-VolumesExtendTest-407232047 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25' failed. Not Retrying. {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:05:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f779fa3e-58a5-4762-ab41-df5e06ecae65 tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 2G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f779fa3e-58a5-4762-ab41-df5e06ecae65 tempest-VolumesExtendTest-407232047 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 2G" returned: 0 in 0.061s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f779fa3e-58a5-4762-ab41-df5e06ecae65 tempest-VolumesExtendTest-407232047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.396s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:49 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-f779fa3e-58a5-4762-ab41-df5e06ecae65 tempest-VolumesExtendTest-407232047 None] Extend volume completed successfully. Feb 27 02:05:49 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1ba7f3b9-71c3-4af2-bdce-d356501b3a80 tempest-GroupsTest-1201261350 None] Acquiring lock "cinder-quobyte-cdaf0bb9-0701-4464-a985-4f3745ac7e04" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:49 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1ba7f3b9-71c3-4af2-bdce-d356501b3a80 tempest-GroupsTest-1201261350 None] Lock "cinder-quobyte-cdaf0bb9-0701-4464-a985-4f3745ac7e04" acquired by "delete_volume" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:49 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[322fd796-0009-4a04-9525-46fd136e3195]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1ba7f3b9-71c3-4af2-bdce-d356501b3a80 tempest-GroupsTest-1201261350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cdaf0bb9-0701-4464-a985-4f3745ac7e04 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:49 devstack sudo[87436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cdaf0bb9-0701-4464-a985-4f3745ac7e04 Feb 27 02:05:49 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:49 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a4dda042-ec67-45c1-9d71-54266c0441e4 tempest-VolumesActionsTest-682815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.586s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:49 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-a4dda042-ec67-45c1-9d71-54266c0441e4 tempest-VolumesActionsTest-682815822 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:49 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-a4dda042-ec67-45c1-9d71-54266c0441e4 tempest-VolumesActionsTest-682815822 None] Deleted volume successfully. Feb 27 02:05:49 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a4dda042-ec67-45c1-9d71-54266c0441e4 tempest-VolumesActionsTest-682815822 None] Lock "cinder-1110b59b-04c5-4975-9085-1a24ae4fdf45-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:50 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1ba7f3b9-71c3-4af2-bdce-d356501b3a80 tempest-GroupsTest-1201261350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cdaf0bb9-0701-4464-a985-4f3745ac7e04" returned: 0 in 0.610s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1ba7f3b9-71c3-4af2-bdce-d356501b3a80 tempest-GroupsTest-1201261350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cdaf0bb9-0701-4464-a985-4f3745ac7e04 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:50 devstack sudo[87443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cdaf0bb9-0701-4464-a985-4f3745ac7e04 Feb 27 02:05:50 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] Acquiring lock "cinder-a142e84c-0d66-4aa5-9ce5-8148580f6c25-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] Lock "cinder-a142e84c-0d66-4aa5-9ce5-8148580f6c25-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] Acquiring lock "cinder-quobyte-a142e84c-0d66-4aa5-9ce5-8148580f6c25" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:05:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] Lock "cinder-quobyte-a142e84c-0d66-4aa5-9ce5-8148580f6c25" acquired by "delete_volume" :: waited 0.018s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:05:50 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6006064b-f698-4f1a-af9b-d0ffcf20914a]: (4, 'raw') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:50 devstack sudo[87445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 Feb 27 02:05:50 devstack sudo[87445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:50 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1ba7f3b9-71c3-4af2-bdce-d356501b3a80 tempest-GroupsTest-1201261350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cdaf0bb9-0701-4464-a985-4f3745ac7e04" returned: 0 in 0.519s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1ba7f3b9-71c3-4af2-bdce-d356501b3a80 tempest-GroupsTest-1201261350 None] Lock "cinder-quobyte-cdaf0bb9-0701-4464-a985-4f3745ac7e04" released by "delete_volume" :: held 1.157s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:50 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-1ba7f3b9-71c3-4af2-bdce-d356501b3a80 tempest-GroupsTest-1201261350 None] Created reservations ['8aee3ae6-df8d-4585-981c-a8445c85fa23'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:50 devstack cinder-volume[82683]: WARNING cinder.quota [None req-1ba7f3b9-71c3-4af2-bdce-d356501b3a80 tempest-GroupsTest-1201261350 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1295593062 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1295593062, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:50 devstack cinder-volume[82683]: WARNING cinder.quota [None req-1ba7f3b9-71c3-4af2-bdce-d356501b3a80 tempest-GroupsTest-1201261350 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1295593062 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1295593062, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:05:51 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-1ba7f3b9-71c3-4af2-bdce-d356501b3a80 tempest-GroupsTest-1201261350 None] Created reservations ['6897a542-fe77-40db-898f-88c148b0ed96', '5e0f5f04-f83c-47cf-8530-3e3018e07a31', '7ce6f940-0bb3-4ae0-b175-7ae13ec78a32', 'd725e3a9-7454-4973-ba08-973357063658'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1ba7f3b9-71c3-4af2-bdce-d356501b3a80 tempest-GroupsTest-1201261350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1ba7f3b9-71c3-4af2-bdce-d356501b3a80 tempest-GroupsTest-1201261350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:51 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1ba7f3b9-71c3-4af2-bdce-d356501b3a80 tempest-GroupsTest-1201261350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:51 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1ba7f3b9-71c3-4af2-bdce-d356501b3a80 tempest-GroupsTest-1201261350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1ba7f3b9-71c3-4af2-bdce-d356501b3a80 tempest-GroupsTest-1201261350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1ba7f3b9-71c3-4af2-bdce-d356501b3a80 tempest-GroupsTest-1201261350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:51 devstack sudo[87450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:05:51 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:51 devstack sudo[87445]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25" returned: 0 in 0.678s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:51 devstack sudo[87452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 Feb 27 02:05:51 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:51 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1ba7f3b9-71c3-4af2-bdce-d356501b3a80 tempest-GroupsTest-1201261350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.658s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:51 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-1ba7f3b9-71c3-4af2-bdce-d356501b3a80 tempest-GroupsTest-1201261350 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:51 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-1ba7f3b9-71c3-4af2-bdce-d356501b3a80 tempest-GroupsTest-1201261350 None] Delete group completed successfully. Feb 27 02:05:51 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25" returned: 1 in 0.577s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25' failed. Not Retrying. {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:05:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:51 devstack sudo[87459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25 Feb 27 02:05:51 devstack sudo[87459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:52 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-58ef2535-9b6c-4181-87e3-a930911addfb tempest-GroupsTest-1201261350 None] Created reservations ['020a9eda-5424-4fa6-8ae2-654b451e5e19'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-58ef2535-9b6c-4181-87e3-a930911addfb tempest-GroupsTest-1201261350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-58ef2535-9b6c-4181-87e3-a930911addfb tempest-GroupsTest-1201261350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:52 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-58ef2535-9b6c-4181-87e3-a930911addfb tempest-GroupsTest-1201261350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:52 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-58ef2535-9b6c-4181-87e3-a930911addfb tempest-GroupsTest-1201261350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-58ef2535-9b6c-4181-87e3-a930911addfb tempest-GroupsTest-1201261350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-58ef2535-9b6c-4181-87e3-a930911addfb tempest-GroupsTest-1201261350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:52 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:05:52 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:52 devstack sudo[87459]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a142e84c-0d66-4aa5-9ce5-8148580f6c25" returned: 0 in 0.642s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] Lock "cinder-quobyte-a142e84c-0d66-4aa5-9ce5-8148580f6c25" released by "delete_volume" :: held 1.953s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:52 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] Created reservations ['72b2d102-f462-4a86-9825-b6752da8958e', 'a3ece954-29e7-44b8-964c-75be6ba2ed3f', '157fc124-38ad-4cb3-ac12-f7e91ef9a728', '5c02068b-de7a-48d2-b5e5-d9f65c187f89'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:05:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:52 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:52 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:52 devstack sudo[87465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:05:52 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:52 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-58ef2535-9b6c-4181-87e3-a930911addfb tempest-GroupsTest-1201261350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.642s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:52 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-58ef2535-9b6c-4181-87e3-a930911addfb tempest-GroupsTest-1201261350 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:52 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-58ef2535-9b6c-4181-87e3-a930911addfb tempest-GroupsTest-1201261350 None] Delete group completed successfully. Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Flow 'volume_create_manager' (e3aa6d99-aa4e-4d64-8a7a-dd4066399e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97ef6a0-47bb-430c-97ca-ee86ab7eb6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97ef6a0-47bb-430c-97ca-ee86ab7eb6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1776505769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf067f5cea924cb19a14221fa67e3e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:53Z,use_quota=True,user_id='655ae897e8c34e58870eb6788aad1db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac8ca8c-5704-473d-a956-3329adbee9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac8ca8c-5704-473d-a956-3329adbee9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfda9234-eb2f-4da9-b53c-a6250682cf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfda9234-eb2f-4da9-b53c-a6250682cf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc', 'volume_name': 'volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423f196b-1295-4d39-b0f2-5f1e9a8901dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423f196b-1295-4d39-b0f2-5f1e9a8901dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663e427e-dc20-4034-a997-bb0ff3281473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:53 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Volume 0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc', 'volume_size': 1} Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1776505769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf067f5cea924cb19a14221fa67e3e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:53Z,use_quota=True,user_id='655ae897e8c34e58870eb6788aad1db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Creating volume 0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:53 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:53 devstack sudo[87468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc 1073741824 Feb 27 02:05:53 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:53 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.717s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:05:53 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] Deleted volume successfully. Feb 27 02:05:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f9565a13-be86-4516-803c-2dd218786f4f tempest-VolumesExtendTest-407232047 None] Lock "cinder-a142e84c-0d66-4aa5-9ce5-8148580f6c25-delete_volume" released by "delete_volume" :: held 2.862s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:05:53 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-0fdf38ce-724d-4c1b-a687-0fa2db8c45c2 tempest-GroupsTest-1201261350 None] Group tempest-GroupsTest-Group-477732809: creating Feb 27 02:05:53 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-0fdf38ce-724d-4c1b-a687-0fa2db8c45c2 tempest-GroupsTest-1201261350 None] Group tempest-GroupsTest-Group-477732809: created successfully Feb 27 02:05:53 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-0fdf38ce-724d-4c1b-a687-0fa2db8c45c2 tempest-GroupsTest-1201261350 None] Create group completed successfully. Feb 27 02:05:54 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc 1073741824" returned: 0 in 0.761s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:54 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc Feb 27 02:05:54 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:54 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc" returned: 0 in 0.510s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:54 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663e427e-dc20-4034-a997-bb0ff3281473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df18bc50-d7aa-4399-a3ea-ede4b9937dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:54 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Volume volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc (0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc): created successfully Feb 27 02:05:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df18bc50-d7aa-4399-a3ea-ede4b9937dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Flow 'volume_create_manager' (e3aa6d99-aa4e-4d64-8a7a-dd4066399e1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:54 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-b514a194-6648-4236-a7cc-c99fb4d7355c tempest-VolumesExtendTest-407232047 None] Created volume successfully. Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Flow 'volume_create_manager' (2581e79f-f6bb-4b99-8b96-85004548991e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (303c4a9f-8358-490e-a03d-a8b34904e28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (303c4a9f-8358-490e-a03d-a8b34904e28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-991097741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cb8ae9cf-2dca-473b-b67f-0fe549065957,host='devstack@QuobyteHD#QuobyteHD',id=437a7541-89ac-4161-b81c-92c7662cbc2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08641c6543ab4b94a02b89f7bd8045e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:55Z,use_quota=True,user_id='44dba7cf884b48a58a98fcac334a1e69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61a9757c-7c32-425a-991d-a3818fb453bb),volume_type_id=61a9757c-7c32-425a-991d-a3818fb453bb)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b98ab767-a3c7-407f-88c5-a6a3f3ff806c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b98ab767-a3c7-407f-88c5-a6a3f3ff806c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69113d6-902e-44c9-b476-6ed929e2b636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69113d6-902e-44c9-b476-6ed929e2b636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '437a7541-89ac-4161-b81c-92c7662cbc2e', 'volume_name': 'volume-437a7541-89ac-4161-b81c-92c7662cbc2e', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18aa4e16-46b9-40e2-820f-73b4118bcf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18aa4e16-46b9-40e2-820f-73b4118bcf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b94e6c-2894-4d2c-9ae6-2301914c5faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:55 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Volume 437a7541-89ac-4161-b81c-92c7662cbc2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-437a7541-89ac-4161-b81c-92c7662cbc2e', 'volume_size': 1} Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cb8ae9cf-2dca-473b-b67f-0fe549065957,created_at=2026-02-27T01:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-991097741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cb8ae9cf-2dca-473b-b67f-0fe549065957,host='devstack@QuobyteHD#QuobyteHD',id=437a7541-89ac-4161-b81c-92c7662cbc2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08641c6543ab4b94a02b89f7bd8045e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:55Z,use_quota=True,user_id='44dba7cf884b48a58a98fcac334a1e69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61a9757c-7c32-425a-991d-a3818fb453bb),volume_type_id=61a9757c-7c32-425a-991d-a3818fb453bb)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Creating volume 437a7541-89ac-4161-b81c-92c7662cbc2e {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:05:55 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-437a7541-89ac-4161-b81c-92c7662cbc2e 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:55 devstack sudo[87477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-437a7541-89ac-4161-b81c-92c7662cbc2e 1073741824 Feb 27 02:05:55 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0773d58b-0169-4206-b5df-af8b859a25e4 tempest-VolumesExtendTest-407232047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:56 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Flow 'volume_create_manager' (42dffc90-3003-41ac-a104-e1dc49e3e32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5359fd6-921a-4924-8600-bb0467371d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5359fd6-921a-4924-8600-bb0467371d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1022162410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be45e22-2fc1-424e-9716-d7c4a162f27c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d222f4a7e74b9c86fd6c7f66baa164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:56Z,use_quota=True,user_id='ba6ab8584f854355a1e0ab1de916a3e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec432491-ab66-40a7-9bb2-bc4a418a2d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec432491-ab66-40a7-9bb2-bc4a418a2d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd52e32d-bbe1-4f66-84ec-e3cc4c43c206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd52e32d-bbe1-4f66-84ec-e3cc4c43c206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3be45e22-2fc1-424e-9716-d7c4a162f27c', 'volume_name': 'volume-3be45e22-2fc1-424e-9716-d7c4a162f27c', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db22784-df93-4cba-8b90-28e1136b8569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db22784-df93-4cba-8b90-28e1136b8569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35984be6-cc37-4cd5-b0c8-e257cc8eabf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:56 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Volume 3be45e22-2fc1-424e-9716-d7c4a162f27c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3be45e22-2fc1-424e-9716-d7c4a162f27c', 'volume_size': 1} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-437a7541-89ac-4161-b81c-92c7662cbc2e 1073741824" returned: 0 in 0.813s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-437a7541-89ac-4161-b81c-92c7662cbc2e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:56 devstack sudo[87482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-437a7541-89ac-4161-b81c-92c7662cbc2e Feb 27 02:05:56 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:56 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-437a7541-89ac-4161-b81c-92c7662cbc2e" returned: 0 in 0.485s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0773d58b-0169-4206-b5df-af8b859a25e4 tempest-VolumesExtendTest-407232047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.191s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b94e6c-2894-4d2c-9ae6-2301914c5faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-437a7541-89ac-4161-b81c-92c7662cbc2e', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28a5262-eb8b-4dc8-b620-26e8b6b34f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-0773d58b-0169-4206-b5df-af8b859a25e4 tempest-VolumesExtendTest-407232047 None] Creating offline snapshot f70faf5c-5c77-4792-b176-3f5b79bd4b1a of volume 0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a61f09-a94a-496d-a5f5-f1d57aaf73dc]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0773d58b-0169-4206-b5df-af8b859a25e4 tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:56 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Volume volume-437a7541-89ac-4161-b81c-92c7662cbc2e (437a7541-89ac-4161-b81c-92c7662cbc2e): created successfully Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28a5262-eb8b-4dc8-b620-26e8b6b34f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Flow 'volume_create_manager' (2581e79f-f6bb-4b99-8b96-85004548991e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:56 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-2049c938-095f-4111-adef-6259f8e2117c tempest-GroupsTest-1201261350 None] Created volume successfully. Feb 27 02:05:56 devstack sudo[87485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc Feb 27 02:05:56 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:57 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0773d58b-0169-4206-b5df-af8b859a25e4 tempest-VolumesExtendTest-407232047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc" returned: 0 in 0.682s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0773d58b-0169-4206-b5df-af8b859a25e4 tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:57 devstack sudo[87490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a 1G Feb 27 02:05:57 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:57 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Flow 'volume_create_manager' (3749c1a0-b09f-42fd-b1ae-9dae71dc0693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e025f1-3b40-4484-816a-60de6febc906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e025f1-3b40-4484-816a-60de6febc906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-920702576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cb8ae9cf-2dca-473b-b67f-0fe549065957,host='devstack@QuobyteHD#QuobyteHD',id=bd00dbba-dcac-404d-b0dc-45e0b4c5d41a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08641c6543ab4b94a02b89f7bd8045e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:58Z,use_quota=True,user_id='44dba7cf884b48a58a98fcac334a1e69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61a9757c-7c32-425a-991d-a3818fb453bb),volume_type_id=61a9757c-7c32-425a-991d-a3818fb453bb)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a72048a-3da4-456e-870b-76d7bd3d7193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a72048a-3da4-456e-870b-76d7bd3d7193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9878ecaf-9c9b-48d1-a7ff-8abc9bccd748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9878ecaf-9c9b-48d1-a7ff-8abc9bccd748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd00dbba-dcac-404d-b0dc-45e0b4c5d41a', 'volume_name': 'volume-bd00dbba-dcac-404d-b0dc-45e0b4c5d41a', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fac03b5-df65-4cf9-989b-04a45b380cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fac03b5-df65-4cf9-989b-04a45b380cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e3f26d-8b8b-4b12-9346-ad02faeca648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:57 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Volume bd00dbba-dcac-404d-b0dc-45e0b4c5d41a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd00dbba-dcac-404d-b0dc-45e0b4c5d41a', 'volume_size': 1} Feb 27 02:05:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:58 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0773d58b-0169-4206-b5df-af8b859a25e4 tempest-VolumesExtendTest-407232047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a 1G" returned: 0 in 0.641s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0773d58b-0169-4206-b5df-af8b859a25e4 tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:58 devstack sudo[87495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a Feb 27 02:05:58 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:58 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0773d58b-0169-4206-b5df-af8b859a25e4 tempest-VolumesExtendTest-407232047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a" returned: 0 in 0.578s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:58 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-0773d58b-0169-4206-b5df-af8b859a25e4 tempest-VolumesExtendTest-407232047 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a is being set with open permissions: ugo+rw Feb 27 02:05:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0773d58b-0169-4206-b5df-af8b859a25e4 tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:58 devstack sudo[87501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a Feb 27 02:05:58 devstack sudo[87501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:59 devstack sudo[87501]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0773d58b-0169-4206-b5df-af8b859a25e4 tempest-VolumesExtendTest-407232047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a" returned: 0 in 0.465s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0773d58b-0169-4206-b5df-af8b859a25e4 tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:59 devstack sudo[87504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.info Feb 27 02:05:59 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:05:59 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:05:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Flow 'volume_create_manager' (6930b7d3-d714-45cd-a60e-a52563366b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:05:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3731a0dc-fcfb-4239-8239-ffcdafe46f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3731a0dc-fcfb-4239-8239-ffcdafe46f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-184840342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db8da76f-2d35-4e02-8e4c-f7684426bb53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e097afbc046b4551a8ca775c67f6fd07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:59Z,use_quota=True,user_id='214809ad7faa47d3b4302b8e418496a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (736bc423-fe65-44be-bd42-c777103d7494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (736bc423-fe65-44be-bd42-c777103d7494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead050e1-9de6-4883-8445-ff28bfee9500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ead050e1-9de6-4883-8445-ff28bfee9500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db8da76f-2d35-4e02-8e4c-f7684426bb53', 'volume_name': 'volume-db8da76f-2d35-4e02-8e4c-f7684426bb53', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f022de-8b07-4a92-bd2d-4f3a68ff31e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f022de-8b07-4a92-bd2d-4f3a68ff31e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:05:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4bb5c0-d760-4a99-bdae-5d18a741081f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:05:59 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Volume db8da76f-2d35-4e02-8e4c-f7684426bb53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db8da76f-2d35-4e02-8e4c-f7684426bb53', 'volume_size': 1} Feb 27 02:05:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:05:59 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root Feb 27 02:05:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0773d58b-0169-4206-b5df-af8b859a25e4 tempest-VolumesExtendTest-407232047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.info" returned: 0 in 0.483s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:05:59 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-0773d58b-0169-4206-b5df-af8b859a25e4 tempest-VolumesExtendTest-407232047 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.info is being set with open permissions: ugo+rw Feb 27 02:05:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0773d58b-0169-4206-b5df-af8b859a25e4 tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:05:59 devstack sudo[87507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.info Feb 27 02:05:59 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:00 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0773d58b-0169-4206-b5df-af8b859a25e4 tempest-VolumesExtendTest-407232047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.info" returned: 0 in 0.416s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0773d58b-0169-4206-b5df-af8b859a25e4 tempest-VolumesExtendTest-407232047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.365s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.908s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1022162410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be45e22-2fc1-424e-9716-d7c4a162f27c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d222f4a7e74b9c86fd6c7f66baa164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:56Z,use_quota=True,user_id='ba6ab8584f854355a1e0ab1de916a3e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Creating volume 3be45e22-2fc1-424e-9716-d7c4a162f27c {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:00 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:06:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:00 devstack sudo[87510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c 1073741824 Feb 27 02:06:00 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:00 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-0773d58b-0169-4206-b5df-af8b859a25e4 tempest-VolumesExtendTest-407232047 None] Create snapshot completed successfully Feb 27 02:06:00 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c 1073741824" returned: 0 in 0.497s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:00 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c Feb 27 02:06:00 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ce194a9c-5958-4bd2-8715-547e7649f4c9 tempest-VolumesExtendTest-407232047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:01 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c" returned: 0 in 0.479s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.264s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cb8ae9cf-2dca-473b-b67f-0fe549065957,created_at=2026-02-27T01:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-920702576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cb8ae9cf-2dca-473b-b67f-0fe549065957,host='devstack@QuobyteHD#QuobyteHD',id=bd00dbba-dcac-404d-b0dc-45e0b4c5d41a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08641c6543ab4b94a02b89f7bd8045e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:58Z,use_quota=True,user_id='44dba7cf884b48a58a98fcac334a1e69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61a9757c-7c32-425a-991d-a3818fb453bb),volume_type_id=61a9757c-7c32-425a-991d-a3818fb453bb)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Creating volume bd00dbba-dcac-404d-b0dc-45e0b4c5d41a {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:01 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd00dbba-dcac-404d-b0dc-45e0b4c5d41a 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35984be6-cc37-4cd5-b0c8-e257cc8eabf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3be45e22-2fc1-424e-9716-d7c4a162f27c', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:01 devstack sudo[87518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd00dbba-dcac-404d-b0dc-45e0b4c5d41a 1073741824 Feb 27 02:06:01 devstack sudo[87518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998127e1-35d7-404f-8b89-13a1eaa6945c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:01 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Volume volume-3be45e22-2fc1-424e-9716-d7c4a162f27c (3be45e22-2fc1-424e-9716-d7c4a162f27c): created successfully Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998127e1-35d7-404f-8b89-13a1eaa6945c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Flow 'volume_create_manager' (42dffc90-3003-41ac-a104-e1dc49e3e32c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:01 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-3903d5e1-2ec9-4bf3-a217-2970ab12ef62 tempest-VolumesCloneTest-1173058135 None] Created volume successfully. Feb 27 02:06:01 devstack sudo[87518]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd00dbba-dcac-404d-b0dc-45e0b4c5d41a 1073741824" returned: 0 in 0.632s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd00dbba-dcac-404d-b0dc-45e0b4c5d41a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:01 devstack sudo[87523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd00dbba-dcac-404d-b0dc-45e0b4c5d41a Feb 27 02:06:01 devstack sudo[87523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Flow 'volume_create_manager' (9cf7316a-5b34-48b3-b063-47b0d21e7220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73261360-dcb2-49eb-bdfe-7b87aa40a1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73261360-dcb2-49eb-bdfe-7b87aa40a1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2116776109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9078185b-c026-4ad3-8a91-87022496e04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d222f4a7e74b9c86fd6c7f66baa164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=3be45e22-2fc1-424e-9716-d7c4a162f27c,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:02Z,use_quota=True,user_id='ba6ab8584f854355a1e0ab1de916a3e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dccdbd1-ef7a-42e5-82e5-17c6971df7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dccdbd1-ef7a-42e5-82e5-17c6971df7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11731243-3ba7-4160-9172-f012935d3825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11731243-3ba7-4160-9172-f012935d3825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9078185b-c026-4ad3-8a91-87022496e04d', 'volume_name': 'volume-9078185b-c026-4ad3-8a91-87022496e04d', 'volume_size': 2, 'source_volid': '3be45e22-2fc1-424e-9716-d7c4a162f27c', 'source_volstatus': 'available'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31dcc24-6c2e-41a0-8ecc-ee0b66afbbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31dcc24-6c2e-41a0-8ecc-ee0b66afbbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1df6ad-8911-4850-a927-ccce1581454f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:01 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Volume 9078185b-c026-4ad3-8a91-87022496e04d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9078185b-c026-4ad3-8a91-87022496e04d', 'volume_size': 2, 'source_volid': '3be45e22-2fc1-424e-9716-d7c4a162f27c', 'source_volstatus': 'available'} Feb 27 02:06:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:02 devstack sudo[87523]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd00dbba-dcac-404d-b0dc-45e0b4c5d41a" returned: 0 in 0.424s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:02 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.618s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:02 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-184840342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db8da76f-2d35-4e02-8e4c-f7684426bb53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e097afbc046b4551a8ca775c67f6fd07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:05:59Z,use_quota=True,user_id='214809ad7faa47d3b4302b8e418496a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:02 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Creating volume db8da76f-2d35-4e02-8e4c-f7684426bb53 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:02 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:02 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:02 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:02 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:06:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-db8da76f-2d35-4e02-8e4c-f7684426bb53 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:02 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e3f26d-8b8b-4b12-9346-ad02faeca648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd00dbba-dcac-404d-b0dc-45e0b4c5d41a', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:02 devstack sudo[87526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-db8da76f-2d35-4e02-8e4c-f7684426bb53 1073741824 Feb 27 02:06:02 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:02 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a48ccfe4-318e-4f5e-bcf0-d885c0ecc932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:02 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Volume volume-bd00dbba-dcac-404d-b0dc-45e0b4c5d41a (bd00dbba-dcac-404d-b0dc-45e0b4c5d41a): created successfully Feb 27 02:06:02 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a48ccfe4-318e-4f5e-bcf0-d885c0ecc932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:02 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Flow 'volume_create_manager' (3749c1a0-b09f-42fd-b1ae-9dae71dc0693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:02 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-5af2691d-fb09-4a7b-b8fd-a0ab0be0cb20 tempest-GroupsTest-1201261350 None] Created volume successfully. Feb 27 02:06:02 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-db8da76f-2d35-4e02-8e4c-f7684426bb53 1073741824" returned: 0 in 0.544s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-db8da76f-2d35-4e02-8e4c-f7684426bb53 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:02 devstack sudo[87531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-db8da76f-2d35-4e02-8e4c-f7684426bb53 Feb 27 02:06:02 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:03 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-db8da76f-2d35-4e02-8e4c-f7684426bb53" returned: 0 in 0.448s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ce194a9c-5958-4bd2-8715-547e7649f4c9 tempest-VolumesExtendTest-407232047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.418s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4bb5c0-d760-4a99-bdae-5d18a741081f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db8da76f-2d35-4e02-8e4c-f7684426bb53', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8579e36-265c-432c-ab68-3465e65b4a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:03 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[199762d5-8e5b-4d63-abae-7914a90225ae]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ce194a9c-5958-4bd2-8715-547e7649f4c9 tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:03 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Volume volume-db8da76f-2d35-4e02-8e4c-f7684426bb53 (db8da76f-2d35-4e02-8e4c-f7684426bb53): created successfully Feb 27 02:06:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8579e36-265c-432c-ab68-3465e65b4a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Flow 'volume_create_manager' (6930b7d3-d714-45cd-a60e-a52563366b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:03 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-85d6630a-2dec-4f76-851c-8f440d0f683e tempest-VolumeQuotasAdminTestJSON-1315624930 None] Created volume successfully. Feb 27 02:06:03 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-b0f9d2e3-deae-410a-983d-0ea9a1349e34 tempest-GroupsTest-1201261350 None] Update group completed successfully. Feb 27 02:06:03 devstack sudo[87534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc Feb 27 02:06:03 devstack sudo[87534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:03 devstack sudo[87534]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ce194a9c-5958-4bd2-8715-547e7649f4c9 tempest-VolumesExtendTest-407232047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc" returned: 0 in 0.521s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ce194a9c-5958-4bd2-8715-547e7649f4c9 tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a 2G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:03 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2445ecb2-6712-4245-9e00-773dc75be6e3 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Acquiring lock "cinder-db8da76f-2d35-4e02-8e4c-f7684426bb53-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:03 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2445ecb2-6712-4245-9e00-773dc75be6e3 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Lock "cinder-db8da76f-2d35-4e02-8e4c-f7684426bb53-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:03 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2445ecb2-6712-4245-9e00-773dc75be6e3 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Acquiring lock "cinder-quobyte-db8da76f-2d35-4e02-8e4c-f7684426bb53" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ce194a9c-5958-4bd2-8715-547e7649f4c9 tempest-VolumesExtendTest-407232047 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a 2G" returned: 0 in 0.124s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ce194a9c-5958-4bd2-8715-547e7649f4c9 tempest-VolumesExtendTest-407232047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.677s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.017s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:03 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Cloning volume 3be45e22-2fc1-424e-9716-d7c4a162f27c to volume 9078185b-c026-4ad3-8a91-87022496e04d Feb 27 02:06:03 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2445ecb2-6712-4245-9e00-773dc75be6e3 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Lock "cinder-quobyte-db8da76f-2d35-4e02-8e4c-f7684426bb53" acquired by "delete_volume" :: waited 0.022s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:03 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[620d95f2-57e9-4c73-9e05-226b97e9d106]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2445ecb2-6712-4245-9e00-773dc75be6e3 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-db8da76f-2d35-4e02-8e4c-f7684426bb53 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:03 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-ce194a9c-5958-4bd2-8715-547e7649f4c9 tempest-VolumesExtendTest-407232047 None] Extend volume completed successfully. Feb 27 02:06:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Creating offline snapshot 38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f of volume 3be45e22-2fc1-424e-9716-d7c4a162f27c {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:06:04 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f106c52-bac5-4721-a3a3-ec204540c162]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:04 devstack sudo[87542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-db8da76f-2d35-4e02-8e4c-f7684426bb53 Feb 27 02:06:04 devstack sudo[87542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:04 devstack sudo[87543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c Feb 27 02:06:04 devstack sudo[87543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:04 devstack sudo[87542]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:04 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-b24ea48c-e38d-47d4-a93f-11a5841fa03a tempest-GroupsTest-1201261350 None] Update group completed successfully. Feb 27 02:06:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2445ecb2-6712-4245-9e00-773dc75be6e3 tempest-VolumeQuotasAdminTestJSON-1315624930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-db8da76f-2d35-4e02-8e4c-f7684426bb53" returned: 0 in 0.570s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2445ecb2-6712-4245-9e00-773dc75be6e3 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-db8da76f-2d35-4e02-8e4c-f7684426bb53 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:04 devstack sudo[87549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-db8da76f-2d35-4e02-8e4c-f7684426bb53 Feb 27 02:06:04 devstack sudo[87549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:04 devstack sudo[87543]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c" returned: 0 in 0.615s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:04 devstack sudo[87554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f 1G Feb 27 02:06:04 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:04 devstack sudo[87549]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2445ecb2-6712-4245-9e00-773dc75be6e3 tempest-VolumeQuotasAdminTestJSON-1315624930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-db8da76f-2d35-4e02-8e4c-f7684426bb53" returned: 0 in 0.448s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2445ecb2-6712-4245-9e00-773dc75be6e3 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Lock "cinder-quobyte-db8da76f-2d35-4e02-8e4c-f7684426bb53" released by "delete_volume" :: held 1.046s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-2445ecb2-6712-4245-9e00-773dc75be6e3 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Created reservations ['1d5bbb83-971d-4b41-8db2-ccaeab57310d', '1bf29c45-fcd6-4daf-965d-b8cf778d4a1c', '25fb0b8a-ea5a-4a49-ade1-ba5ce3504b41', '03b1b718-1144-45b3-9034-b2a53ad2123f'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2445ecb2-6712-4245-9e00-773dc75be6e3 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2445ecb2-6712-4245-9e00-773dc75be6e3 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2445ecb2-6712-4245-9e00-773dc75be6e3 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2445ecb2-6712-4245-9e00-773dc75be6e3 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2445ecb2-6712-4245-9e00-773dc75be6e3 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2445ecb2-6712-4245-9e00-773dc75be6e3 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:05 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:06:05 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:05 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] Acquiring lock "cinder-f70faf5c-5c77-4792-b176-3f5b79bd4b1a-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f 1G" returned: 0 in 0.570s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be45e22-2fc1-424e-9716-d7c4a162f27c -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] Lock "cinder-f70faf5c-5c77-4792-b176-3f5b79bd4b1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] Acquiring lock "cinder-quobyte-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:05 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be45e22-2fc1-424e-9716-d7c4a162f27c -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f Feb 27 02:06:05 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] Lock "cinder-quobyte-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] Acquiring lock "cinder-quobyte-f70faf5c-5c77-4792-b176-3f5b79bd4b1a" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] Lock "cinder-quobyte-f70faf5c-5c77-4792-b176-3f5b79bd4b1a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] Deleting offline snapshot f70faf5c-5c77-4792-b176-3f5b79bd4b1a of volume 0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] snapshot_file for this snap is: volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8ce7ef-2bd9-4590-ad0a-38324e2d5096]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:05 devstack sudo[87564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a Feb 27 02:06:05 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:05 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2445ecb2-6712-4245-9e00-773dc75be6e3 tempest-VolumeQuotasAdminTestJSON-1315624930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.508s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-2445ecb2-6712-4245-9e00-773dc75be6e3 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:05 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-2445ecb2-6712-4245-9e00-773dc75be6e3 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Deleted volume successfully. Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2445ecb2-6712-4245-9e00-773dc75be6e3 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Lock "cinder-db8da76f-2d35-4e02-8e4c-f7684426bb53-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:05 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be45e22-2fc1-424e-9716-d7c4a162f27c -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f" returned: 0 in 0.539s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:05 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f is being set with open permissions: ugo+rw Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:05 devstack sudo[87573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f Feb 27 02:06:05 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:05 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a" returned: 0 in 0.564s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3750a28-26b1-4ac2-84e1-f9cba06e8359]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Acquiring lock "cinder-quobyte-437a7541-89ac-4161-b81c-92c7662cbc2e" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Lock "cinder-quobyte-437a7541-89ac-4161-b81c-92c7662cbc2e" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7161865-5a39-4d0c-a83d-873a1f87aad6]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-437a7541-89ac-4161-b81c-92c7662cbc2e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:05 devstack sudo[87575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc Feb 27 02:06:05 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:05 devstack sudo[87576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-437a7541-89ac-4161-b81c-92c7662cbc2e Feb 27 02:06:05 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:06 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f" returned: 0 in 0.515s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:06 devstack sudo[87612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.info Feb 27 02:06:06 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:06 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc" returned: 0 in 0.648s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:06 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-437a7541-89ac-4161-b81c-92c7662cbc2e" returned: 0 in 0.615s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-437a7541-89ac-4161-b81c-92c7662cbc2e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:06 devstack sudo[87622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a Feb 27 02:06:06 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:06 devstack sudo[87623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-437a7541-89ac-4161-b81c-92c7662cbc2e Feb 27 02:06:06 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:06 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Flow 'volume_create_manager' (a38b5ab2-654b-4012-beab-66820e5d4290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a69d8a-fe96-4897-bc1f-94fa68dd0d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a69d8a-fe96-4897-bc1f-94fa68dd0d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1739674965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f580fc-9c99-4d65-9009-b4c43fc81a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e097afbc046b4551a8ca775c67f6fd07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:07Z,use_quota=True,user_id='214809ad7faa47d3b4302b8e418496a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6d414d-9c43-400a-814d-f8fdad34681d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6d414d-9c43-400a-814d-f8fdad34681d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cebc822-b928-4db5-b137-15593b64c296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cebc822-b928-4db5-b137-15593b64c296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64f580fc-9c99-4d65-9009-b4c43fc81a62', 'volume_name': 'volume-64f580fc-9c99-4d65-9009-b4c43fc81a62', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40b9305-949a-4877-b2be-343e6d859e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b40b9305-949a-4877-b2be-343e6d859e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb998fb0-4ead-496f-a129-de9381af948b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:06 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Volume 64f580fc-9c99-4d65-9009-b4c43fc81a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64f580fc-9c99-4d65-9009-b4c43fc81a62', 'volume_size': 1} Feb 27 02:06:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:06 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.info" returned: 0 in 0.536s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:06 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.info is being set with open permissions: ugo+rw Feb 27 02:06:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:06 devstack sudo[87627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.info Feb 27 02:06:06 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:07 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-437a7541-89ac-4161-b81c-92c7662cbc2e" returned: 0 in 0.485s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Lock "cinder-quobyte-437a7541-89ac-4161-b81c-92c7662cbc2e" released by "delete_volume" :: held 1.133s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Acquiring lock "cinder-quobyte-bd00dbba-dcac-404d-b0dc-45e0b4c5d41a" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Lock "cinder-quobyte-bd00dbba-dcac-404d-b0dc-45e0b4c5d41a" acquired by "delete_volume" :: waited 0.007s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b6fae9-66aa-459d-bc1f-15a610a00a3e]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd00dbba-dcac-404d-b0dc-45e0b4c5d41a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:07 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a" returned: 0 in 0.565s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:07 devstack sudo[87634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a Feb 27 02:06:07 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:07 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd00dbba-dcac-404d-b0dc-45e0b4c5d41a Feb 27 02:06:07 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:07 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.info" returned: 0 in 0.479s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Acquiring lock "cinder-quobyte-9078185b-c026-4ad3-8a91-87022496e04d" by "_copy_volume_from_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Lock "cinder-quobyte-9078185b-c026-4ad3-8a91-87022496e04d" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] snapshot: 38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f, volume: 9078185b-c026-4ad3-8a91-87022496e04d, {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a439db77-353c-428d-9475-aa3922c3351b]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:07 devstack sudo[87638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f Feb 27 02:06:07 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:07 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc.f70faf5c-5c77-4792-b176-3f5b79bd4b1a" returned: 0 in 0.468s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] Lock "cinder-quobyte-f70faf5c-5c77-4792-b176-3f5b79bd4b1a" released by "_delete_snapshot" :: held 2.317s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] Lock "cinder-quobyte-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc" released by "delete_snapshot" :: held 2.329s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] Created reservations ['683dbac4-638e-4c6d-87c6-5e64e902b8c6', 'cceb77fa-4f9f-4c58-b596-f30dcc3fa793', '09d98fed-1b19-406f-9389-21fd3dc75852', 'fc9f0a92-4722-4a71-b437-06b734505c02'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:07 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] Delete snapshot completed successfully. Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-469f6e9f-a4f3-4dcb-88ce-008b0b861193 tempest-VolumesExtendTest-407232047 None] Lock "cinder-f70faf5c-5c77-4792-b176-3f5b79bd4b1a-delete_snapshot" released by "delete_snapshot" :: held 2.430s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:07 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd00dbba-dcac-404d-b0dc-45e0b4c5d41a" returned: 0 in 0.622s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd00dbba-dcac-404d-b0dc-45e0b4c5d41a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:07 devstack sudo[87644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd00dbba-dcac-404d-b0dc-45e0b4c5d41a Feb 27 02:06:07 devstack sudo[87644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:07 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f" returned: 0 in 0.608s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3be45e22-2fc1-424e-9716-d7c4a162f27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] will copy from snapshot at /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Creating direct copy from snapshot {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e108edc-2be7-4688-b012-b257eb0423bb]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:08 devstack sudo[87649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c Feb 27 02:06:08 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:08 devstack sudo[87644]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bd00dbba-dcac-404d-b0dc-45e0b4c5d41a" returned: 0 in 0.483s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:08 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Lock "cinder-quobyte-bd00dbba-dcac-404d-b0dc-45e0b4c5d41a" released by "delete_volume" :: held 1.136s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:08 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Created reservations ['e5eecf34-06e7-4137-b9aa-8c2ef63a3807'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:08 devstack cinder-volume[82683]: WARNING cinder.quota [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-172089449 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-172089449, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:06:08 devstack cinder-volume[82683]: WARNING cinder.quota [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-172089449 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-172089449, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:06:08 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Created reservations ['8ad3bd42-77c1-4ca3-802f-a92dc28cd439', '1efa48ad-78ac-4dea-b2fd-973401795bb3', 'c2a731cf-a3a9-4a16-a781-886b76584544', 'db8d7d74-321d-4e2f-bb04-d80081a3d146'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:08 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Created reservations ['95aa5b88-d7d6-4b1a-8bf9-8af033193c3c', 'cf3395af-e126-471d-95af-88fc413c471d', '993b8de9-2065-4ce8-b8cb-99904e52f55b', '13f3aa47-9135-4264-acf8-24944e259911'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:08 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:08 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:08 devstack sudo[87661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:06:08 devstack sudo[87661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:08 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e4481f7e-ba67-4dca-8fe3-aa8fd4dc9dce tempest-VolumesExtendTest-407232047 None] Acquiring lock "cinder-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:08 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e4481f7e-ba67-4dca-8fe3-aa8fd4dc9dce tempest-VolumesExtendTest-407232047 None] Lock "cinder-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:08 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e4481f7e-ba67-4dca-8fe3-aa8fd4dc9dce tempest-VolumesExtendTest-407232047 None] Acquiring lock "cinder-quobyte-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:08 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e4481f7e-ba67-4dca-8fe3-aa8fd4dc9dce tempest-VolumesExtendTest-407232047 None] Lock "cinder-quobyte-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc" acquired by "delete_volume" :: waited 0.007s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:08 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c" returned: 0 in 0.621s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:08 devstack cinder-volume[82683]: DEBUG cinder.utils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Path /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9078185b-c026-4ad3-8a91-87022496e04d not found in is_blk_device check {{(pid=82683) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:06:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9078185b-c026-4ad3-8a91-87022496e04d {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:08 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e053494-9ef0-4fe5-86a5-8e63bb08d9ea]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e4481f7e-ba67-4dca-8fe3-aa8fd4dc9dce tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:08 devstack sudo[87664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9078185b-c026-4ad3-8a91-87022496e04d Feb 27 02:06:08 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:08 devstack sudo[87665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc Feb 27 02:06:08 devstack sudo[87665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:09 devstack cinder-volume[82683]: DEBUG oslo_service.periodic_task [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:06:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:09 devstack sudo[87661]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.973s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:09 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:09 devstack sudo[87684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:06:09 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:09 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-baf74c41-6f11-4147-9d53-aaa9357b5dd6 tempest-GroupsTest-1201261350 None] Delete group completed successfully. Feb 27 02:06:09 devstack sudo[87665]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e4481f7e-ba67-4dca-8fe3-aa8fd4dc9dce tempest-VolumesExtendTest-407232047 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc" returned: 0 in 0.928s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e4481f7e-ba67-4dca-8fe3-aa8fd4dc9dce tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:09 devstack sudo[87686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc Feb 27 02:06:09 devstack sudo[87686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:10 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 1.351s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:10 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:11 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9078185b-c026-4ad3-8a91-87022496e04d" returned: 0 in 2.718s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:11 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6cf8e1-7dab-476a-8d24-9d7f92781ebd]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:11 devstack sudo[87689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c Feb 27 02:06:11 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:11 devstack sudo[87686]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e4481f7e-ba67-4dca-8fe3-aa8fd4dc9dce tempest-VolumesExtendTest-407232047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc" returned: 0 in 1.898s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:11 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e4481f7e-ba67-4dca-8fe3-aa8fd4dc9dce tempest-VolumesExtendTest-407232047 None] Lock "cinder-quobyte-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc" released by "delete_volume" :: held 2.884s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:11 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:SELECT=135,cinder:UPDATE=133,cinder:DELETE=10,cinder:INSERT=46 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:06:11 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-e4481f7e-ba67-4dca-8fe3-aa8fd4dc9dce tempest-VolumesExtendTest-407232047 None] Created reservations ['9ec3b2ef-8841-4e04-8e7f-9ab5b3ed6375', '87775b14-e3a9-4298-ab84-c90ba271d46c', '3b0cff21-55e7-4d93-836c-8f535f9908f4', '4264b8e8-0a0b-45f9-ae38-cf541120db70'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e4481f7e-ba67-4dca-8fe3-aa8fd4dc9dce tempest-VolumesExtendTest-407232047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e4481f7e-ba67-4dca-8fe3-aa8fd4dc9dce tempest-VolumesExtendTest-407232047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e4481f7e-ba67-4dca-8fe3-aa8fd4dc9dce tempest-VolumesExtendTest-407232047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e4481f7e-ba67-4dca-8fe3-aa8fd4dc9dce tempest-VolumesExtendTest-407232047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e4481f7e-ba67-4dca-8fe3-aa8fd4dc9dce tempest-VolumesExtendTest-407232047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e4481f7e-ba67-4dca-8fe3-aa8fd4dc9dce tempest-VolumesExtendTest-407232047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:11 devstack sudo[87692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:06:11 devstack sudo[87692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:12 devstack sudo[87692]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e4481f7e-ba67-4dca-8fe3-aa8fd4dc9dce tempest-VolumesExtendTest-407232047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.545s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:12 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-e4481f7e-ba67-4dca-8fe3-aa8fd4dc9dce tempest-VolumesExtendTest-407232047 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:12 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-e4481f7e-ba67-4dca-8fe3-aa8fd4dc9dce tempest-VolumesExtendTest-407232047 None] Deleted volume successfully. Feb 27 02:06:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e4481f7e-ba67-4dca-8fe3-aa8fd4dc9dce tempest-VolumesExtendTest-407232047 None] Lock "cinder-0b6b6f5d-0c0f-48ac-83b3-8b303ba25efc-delete_volume" released by "delete_volume" :: held 3.591s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:12 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c" returned: 0 in 0.827s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:12 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Image conversion details: src /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c, size 1024.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9078185b-c026-4ad3-8a91-87022496e04d {{(pid=82683) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:06:12 devstack cinder-volume[82683]: INFO cinder.image.image_utils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Converted 1024.00 MB image at 376.61 MB/s Feb 27 02:06:12 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9078185b-c026-4ad3-8a91-87022496e04d is being set with open permissions: ugo+rw Feb 27 02:06:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9078185b-c026-4ad3-8a91-87022496e04d {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:12 devstack sudo[87698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9078185b-c026-4ad3-8a91-87022496e04d Feb 27 02:06:12 devstack sudo[87698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:12 devstack sudo[87698]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9078185b-c026-4ad3-8a91-87022496e04d" returned: 0 in 0.597s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Lock "cinder-quobyte-9078185b-c026-4ad3-8a91-87022496e04d" released by "_copy_volume_from_snapshot" :: held 5.433s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Acquiring lock "cinder-quobyte-38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Lock "cinder-quobyte-38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:12 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Deleting offline snapshot 38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f of volume 3be45e22-2fc1-424e-9716-d7c4a162f27c {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:06:12 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] snapshot_file for this snap is: volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:06:12 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[96db20df-ccf2-4dc8-96f2-b6721f813326]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:12 devstack sudo[87701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f Feb 27 02:06:12 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:13 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f" returned: 0 in 0.693s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3be45e22-2fc1-424e-9716-d7c4a162f27c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:13 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f8a1bd-58d7-4e65-b3a1-12e826c9d207]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:13 devstack sudo[87706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c Feb 27 02:06:13 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:14 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c" returned: 0 in 0.662s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:14 devstack sudo[87711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f Feb 27 02:06:14 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:14 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Flow 'volume_create_manager' (f9ba8e23-f443-4dec-8cb6-5540d00e926e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce023e2-99cf-45f6-bb59-c4449a9f917f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:14 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:SELECT=136,cinder:INSERT=34,cinder:UPDATE=159,cinder:DELETE=8 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:06:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce023e2-99cf-45f6-bb59-c4449a9f917f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1121567842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d37cdb0-2dd7-42c4-9733-314064a4a1e2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e07111062ffc436da7aa27ae6d219d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:15Z,use_quota=True,user_id='ee4a42c7c9a24aad92ddd645d91b635d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec9fc06-423c-4c95-862a-5e712326f322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec9fc06-423c-4c95-862a-5e712326f322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad86278-272e-4428-b864-4c3115079cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad86278-272e-4428-b864-4c3115079cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d37cdb0-2dd7-42c4-9733-314064a4a1e2', 'volume_name': 'volume-6d37cdb0-2dd7-42c4-9733-314064a4a1e2', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9462b64-87bf-4599-ab6b-803ef41f597e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9462b64-87bf-4599-ab6b-803ef41f597e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23bccec4-1ddf-42e2-bc9e-1f1d53bf9907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:14 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Volume 6d37cdb0-2dd7-42c4-9733-314064a4a1e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d37cdb0-2dd7-42c4-9733-314064a4a1e2', 'volume_size': 1} Feb 27 02:06:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:14 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f" returned: 0 in 0.616s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:14 devstack sudo[87716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f Feb 27 02:06:14 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:15 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c.38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f" returned: 0 in 0.500s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Lock "cinder-quobyte-38c99d8d-ae11-4ec2-a9f6-c1cfea8bb28f" released by "_delete_snapshot" :: held 2.542s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.455s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.725s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:15 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1739674965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64f580fc-9c99-4d65-9009-b4c43fc81a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e097afbc046b4551a8ca775c67f6fd07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:07Z,use_quota=True,user_id='214809ad7faa47d3b4302b8e418496a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:15 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Creating volume 64f580fc-9c99-4d65-9009-b4c43fc81a62 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:15 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:15 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:15 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:15 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:06:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-64f580fc-9c99-4d65-9009-b4c43fc81a62 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1df6ad-8911-4850-a927-ccce1581454f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9078185b-c026-4ad3-8a91-87022496e04d', 'volume_size': 2, 'source_volid': '3be45e22-2fc1-424e-9716-d7c4a162f27c', 'source_volstatus': 'available'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:15 devstack sudo[87719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-64f580fc-9c99-4d65-9009-b4c43fc81a62 1073741824 Feb 27 02:06:15 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2263109a-3d2b-49ec-bd11-a2082a0862d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:15 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Volume volume-9078185b-c026-4ad3-8a91-87022496e04d (9078185b-c026-4ad3-8a91-87022496e04d): created successfully Feb 27 02:06:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2263109a-3d2b-49ec-bd11-a2082a0862d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Flow 'volume_create_manager' (9cf7316a-5b34-48b3-b063-47b0d21e7220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:15 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-cfe171d7-a42f-4e06-856c-1459cea74c17 tempest-VolumesCloneTest-1173058135 None] Created volume successfully. Feb 27 02:06:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6928ff6d-7c92-4b89-832a-79d3406c9a2c tempest-VolumesCloneTest-1173058135 None] Acquiring lock "cinder-9078185b-c026-4ad3-8a91-87022496e04d-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6928ff6d-7c92-4b89-832a-79d3406c9a2c tempest-VolumesCloneTest-1173058135 None] Lock "cinder-9078185b-c026-4ad3-8a91-87022496e04d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6928ff6d-7c92-4b89-832a-79d3406c9a2c tempest-VolumesCloneTest-1173058135 None] Acquiring lock "cinder-quobyte-9078185b-c026-4ad3-8a91-87022496e04d" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6928ff6d-7c92-4b89-832a-79d3406c9a2c tempest-VolumesCloneTest-1173058135 None] Lock "cinder-quobyte-9078185b-c026-4ad3-8a91-87022496e04d" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[62055706-a278-46b3-944d-bcc4ef76c537]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6928ff6d-7c92-4b89-832a-79d3406c9a2c tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9078185b-c026-4ad3-8a91-87022496e04d {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:16 devstack sudo[87724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9078185b-c026-4ad3-8a91-87022496e04d Feb 27 02:06:16 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:16 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-64f580fc-9c99-4d65-9009-b4c43fc81a62 1073741824" returned: 0 in 0.759s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-64f580fc-9c99-4d65-9009-b4c43fc81a62 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:16 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-64f580fc-9c99-4d65-9009-b4c43fc81a62 Feb 27 02:06:16 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:16 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-64f580fc-9c99-4d65-9009-b4c43fc81a62" returned: 0 in 0.473s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.031s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1121567842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d37cdb0-2dd7-42c4-9733-314064a4a1e2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e07111062ffc436da7aa27ae6d219d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:15Z,use_quota=True,user_id='ee4a42c7c9a24aad92ddd645d91b635d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Creating volume 6d37cdb0-2dd7-42c4-9733-314064a4a1e2 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:16 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6d37cdb0-2dd7-42c4-9733-314064a4a1e2 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb998fb0-4ead-496f-a129-de9381af948b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64f580fc-9c99-4d65-9009-b4c43fc81a62', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8652b6b6-ea19-4ed0-a8f2-3787c069f123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:16 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6d37cdb0-2dd7-42c4-9733-314064a4a1e2 1073741824 Feb 27 02:06:16 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:16 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6928ff6d-7c92-4b89-832a-79d3406c9a2c tempest-VolumesCloneTest-1173058135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9078185b-c026-4ad3-8a91-87022496e04d" returned: 0 in 0.674s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6928ff6d-7c92-4b89-832a-79d3406c9a2c tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9078185b-c026-4ad3-8a91-87022496e04d {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:16 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Volume volume-64f580fc-9c99-4d65-9009-b4c43fc81a62 (64f580fc-9c99-4d65-9009-b4c43fc81a62): created successfully Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8652b6b6-ea19-4ed0-a8f2-3787c069f123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:16 devstack sudo[87734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9078185b-c026-4ad3-8a91-87022496e04d Feb 27 02:06:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Flow 'volume_create_manager' (a38b5ab2-654b-4012-beab-66820e5d4290) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:16 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:16 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-d76eec40-d44f-475e-bd2e-e27fa060eea4 tempest-VolumeQuotasAdminTestJSON-1315624930 None] Created volume successfully. Feb 27 02:06:17 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6928ff6d-7c92-4b89-832a-79d3406c9a2c tempest-VolumesCloneTest-1173058135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9078185b-c026-4ad3-8a91-87022496e04d" returned: 0 in 0.564s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:17 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6928ff6d-7c92-4b89-832a-79d3406c9a2c tempest-VolumesCloneTest-1173058135 None] Lock "cinder-quobyte-9078185b-c026-4ad3-8a91-87022496e04d" released by "delete_volume" :: held 1.268s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:17 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-6928ff6d-7c92-4b89-832a-79d3406c9a2c tempest-VolumesCloneTest-1173058135 None] Created reservations ['d1159c5b-a886-4241-a027-24b95d9b9049', '38cc457a-5c4a-4b8e-a1c4-99a2b6156728', 'f7add6d7-30f6-4676-aeb8-04471acc46d0', '86a0fe00-ec7a-4276-a3aa-851686d139aa'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:17 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6d37cdb0-2dd7-42c4-9733-314064a4a1e2 1073741824" returned: 0 in 0.741s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6928ff6d-7c92-4b89-832a-79d3406c9a2c tempest-VolumesCloneTest-1173058135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6928ff6d-7c92-4b89-832a-79d3406c9a2c tempest-VolumesCloneTest-1173058135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:17 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6928ff6d-7c92-4b89-832a-79d3406c9a2c tempest-VolumesCloneTest-1173058135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:17 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6928ff6d-7c92-4b89-832a-79d3406c9a2c tempest-VolumesCloneTest-1173058135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6928ff6d-7c92-4b89-832a-79d3406c9a2c tempest-VolumesCloneTest-1173058135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6928ff6d-7c92-4b89-832a-79d3406c9a2c tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:17 devstack sudo[87740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:06:17 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6d37cdb0-2dd7-42c4-9733-314064a4a1e2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:17 devstack sudo[87742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6d37cdb0-2dd7-42c4-9733-314064a4a1e2 Feb 27 02:06:17 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:17 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6928ff6d-7c92-4b89-832a-79d3406c9a2c tempest-VolumesCloneTest-1173058135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.524s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:17 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-6928ff6d-7c92-4b89-832a-79d3406c9a2c tempest-VolumesCloneTest-1173058135 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:17 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-6928ff6d-7c92-4b89-832a-79d3406c9a2c tempest-VolumesCloneTest-1173058135 None] Deleted volume successfully. Feb 27 02:06:17 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6928ff6d-7c92-4b89-832a-79d3406c9a2c tempest-VolumesCloneTest-1173058135 None] Lock "cinder-9078185b-c026-4ad3-8a91-87022496e04d-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:18 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6d37cdb0-2dd7-42c4-9733-314064a4a1e2" returned: 0 in 0.659s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:18 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:18 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23bccec4-1ddf-42e2-bc9e-1f1d53bf9907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d37cdb0-2dd7-42c4-9733-314064a4a1e2', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:18 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba949f90-c8a2-4f03-bc98-a6d2ec527f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:18 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Volume volume-6d37cdb0-2dd7-42c4-9733-314064a4a1e2 (6d37cdb0-2dd7-42c4-9733-314064a4a1e2): created successfully Feb 27 02:06:18 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba949f90-c8a2-4f03-bc98-a6d2ec527f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:18 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Flow 'volume_create_manager' (f9ba8e23-f443-4dec-8cb6-5540d00e926e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:18 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-8e3b3017-f89b-4f50-9698-707488babc29 tempest-VolumesGetTest-1784211569 None] Created volume successfully. Feb 27 02:06:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-fe2b3b2b-6618-4f84-a2e4-0b3b552a885d tempest-VolumesCloneTest-1173058135 None] Acquiring lock "cinder-3be45e22-2fc1-424e-9716-d7c4a162f27c-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:18 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-d92aafb7-4b19-4699-b613-3ee4240f83a3 tempest-VolumeQuotasAdminTestJSON-53857887 None] Transfer volume completed successfully. Feb 27 02:06:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-fe2b3b2b-6618-4f84-a2e4-0b3b552a885d tempest-VolumesCloneTest-1173058135 None] Lock "cinder-3be45e22-2fc1-424e-9716-d7c4a162f27c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-fe2b3b2b-6618-4f84-a2e4-0b3b552a885d tempest-VolumesCloneTest-1173058135 None] Acquiring lock "cinder-quobyte-3be45e22-2fc1-424e-9716-d7c4a162f27c" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-fe2b3b2b-6618-4f84-a2e4-0b3b552a885d tempest-VolumesCloneTest-1173058135 None] Lock "cinder-quobyte-3be45e22-2fc1-424e-9716-d7c4a162f27c" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:18 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e21b18c-4119-4320-81f9-76775c49ba37]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fe2b3b2b-6618-4f84-a2e4-0b3b552a885d tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:18 devstack sudo[87747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c Feb 27 02:06:18 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:19 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fe2b3b2b-6618-4f84-a2e4-0b3b552a885d tempest-VolumesCloneTest-1173058135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c" returned: 0 in 0.691s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fe2b3b2b-6618-4f84-a2e4-0b3b552a885d tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:19 devstack sudo[87753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c Feb 27 02:06:19 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8ed9ada1-7f2c-4955-b985-f0cac629f223 tempest-VolumeQuotasAdminTestJSON-1643290160 None] Acquiring lock "cinder-64f580fc-9c99-4d65-9009-b4c43fc81a62-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8ed9ada1-7f2c-4955-b985-f0cac629f223 tempest-VolumeQuotasAdminTestJSON-1643290160 None] Lock "cinder-64f580fc-9c99-4d65-9009-b4c43fc81a62-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8ed9ada1-7f2c-4955-b985-f0cac629f223 tempest-VolumeQuotasAdminTestJSON-1643290160 None] Acquiring lock "cinder-quobyte-64f580fc-9c99-4d65-9009-b4c43fc81a62" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8ed9ada1-7f2c-4955-b985-f0cac629f223 tempest-VolumeQuotasAdminTestJSON-1643290160 None] Lock "cinder-quobyte-64f580fc-9c99-4d65-9009-b4c43fc81a62" acquired by "delete_volume" :: waited 0.008s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c90c39-24ec-4c8f-88d7-7918f25d76dc]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8ed9ada1-7f2c-4955-b985-f0cac629f223 tempest-VolumeQuotasAdminTestJSON-1643290160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-64f580fc-9c99-4d65-9009-b4c43fc81a62 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:19 devstack sudo[87755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-64f580fc-9c99-4d65-9009-b4c43fc81a62 Feb 27 02:06:19 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Flow 'volume_create_manager' (2ad355a0-0337-4d10-a881-53b4abe1a70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3ab5fc-7003-44ef-b4ee-949d893a792c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3ab5fc-7003-44ef-b4ee-949d893a792c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-500975092',display_name='tempest-VolumesGetTest-Volume-514077673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05214c50-aa4c-416a-8cec-2245b0400e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07111062ffc436da7aa27ae6d219d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:20Z,use_quota=True,user_id='ee4a42c7c9a24aad92ddd645d91b635d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6302b3-bb66-4d43-a7e9-b3d65a66878e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:19 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6302b3-bb66-4d43-a7e9-b3d65a66878e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143bcdfa-b1dc-4d2e-be9e-8181ab001e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143bcdfa-b1dc-4d2e-be9e-8181ab001e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05214c50-aa4c-416a-8cec-2245b0400e4e', 'volume_name': 'volume-05214c50-aa4c-416a-8cec-2245b0400e4e', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e9fbc6-5d88-43e2-85e5-726213d35b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e9fbc6-5d88-43e2-85e5-726213d35b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c941853-e444-4e86-9fb8-2de8625c838e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:19 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Volume 05214c50-aa4c-416a-8cec-2245b0400e4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05214c50-aa4c-416a-8cec-2245b0400e4e', 'volume_size': 1} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-500975092',display_name='tempest-VolumesGetTest-Volume-514077673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05214c50-aa4c-416a-8cec-2245b0400e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07111062ffc436da7aa27ae6d219d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:20Z,use_quota=True,user_id='ee4a42c7c9a24aad92ddd645d91b635d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Creating volume 05214c50-aa4c-416a-8cec-2245b0400e4e {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:19 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-05214c50-aa4c-416a-8cec-2245b0400e4e 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fe2b3b2b-6618-4f84-a2e4-0b3b552a885d tempest-VolumesCloneTest-1173058135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3be45e22-2fc1-424e-9716-d7c4a162f27c" returned: 0 in 0.672s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-fe2b3b2b-6618-4f84-a2e4-0b3b552a885d tempest-VolumesCloneTest-1173058135 None] Lock "cinder-quobyte-3be45e22-2fc1-424e-9716-d7c4a162f27c" released by "delete_volume" :: held 1.405s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:19 devstack sudo[87758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-05214c50-aa4c-416a-8cec-2245b0400e4e 1073741824 Feb 27 02:06:19 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-fe2b3b2b-6618-4f84-a2e4-0b3b552a885d tempest-VolumesCloneTest-1173058135 None] Created reservations ['635610f2-1a3f-45f4-af88-f8b6813774df', '85266f52-c25a-4441-9662-966b09f98c45', '37317c5a-cf08-4f03-a4f4-73ece5c5fe82', '6d3ce041-e7dc-4e20-8953-705f013a818c'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-fe2b3b2b-6618-4f84-a2e4-0b3b552a885d tempest-VolumesCloneTest-1173058135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-fe2b3b2b-6618-4f84-a2e4-0b3b552a885d tempest-VolumesCloneTest-1173058135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b3b2b-6618-4f84-a2e4-0b3b552a885d tempest-VolumesCloneTest-1173058135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b3b2b-6618-4f84-a2e4-0b3b552a885d tempest-VolumesCloneTest-1173058135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-fe2b3b2b-6618-4f84-a2e4-0b3b552a885d tempest-VolumesCloneTest-1173058135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fe2b3b2b-6618-4f84-a2e4-0b3b552a885d tempest-VolumesCloneTest-1173058135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:19 devstack sudo[87760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:06:19 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:20 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8ed9ada1-7f2c-4955-b985-f0cac629f223 tempest-VolumeQuotasAdminTestJSON-1643290160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-64f580fc-9c99-4d65-9009-b4c43fc81a62" returned: 0 in 0.755s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8ed9ada1-7f2c-4955-b985-f0cac629f223 tempest-VolumeQuotasAdminTestJSON-1643290160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-64f580fc-9c99-4d65-9009-b4c43fc81a62 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:20 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-64f580fc-9c99-4d65-9009-b4c43fc81a62 Feb 27 02:06:20 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:20 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-05214c50-aa4c-416a-8cec-2245b0400e4e 1073741824" returned: 0 in 0.709s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-05214c50-aa4c-416a-8cec-2245b0400e4e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:20 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fe2b3b2b-6618-4f84-a2e4-0b3b552a885d tempest-VolumesCloneTest-1173058135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.634s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:20 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-fe2b3b2b-6618-4f84-a2e4-0b3b552a885d tempest-VolumesCloneTest-1173058135 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:20 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-fe2b3b2b-6618-4f84-a2e4-0b3b552a885d tempest-VolumesCloneTest-1173058135 None] Deleted volume successfully. Feb 27 02:06:20 devstack sudo[87771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-05214c50-aa4c-416a-8cec-2245b0400e4e Feb 27 02:06:20 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:20 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-fe2b3b2b-6618-4f84-a2e4-0b3b552a885d tempest-VolumesCloneTest-1173058135 None] Lock "cinder-3be45e22-2fc1-424e-9716-d7c4a162f27c-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:20 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8ed9ada1-7f2c-4955-b985-f0cac629f223 tempest-VolumeQuotasAdminTestJSON-1643290160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-64f580fc-9c99-4d65-9009-b4c43fc81a62" returned: 0 in 0.525s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:20 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8ed9ada1-7f2c-4955-b985-f0cac629f223 tempest-VolumeQuotasAdminTestJSON-1643290160 None] Lock "cinder-quobyte-64f580fc-9c99-4d65-9009-b4c43fc81a62" released by "delete_volume" :: held 1.312s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:20 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-8ed9ada1-7f2c-4955-b985-f0cac629f223 tempest-VolumeQuotasAdminTestJSON-1643290160 None] Created reservations ['aed3b688-29ff-4887-a0d9-2be58a188887', '85917f0d-5609-4f4e-a847-e759878dbc62', '6fbcd499-9c03-45c0-a7b4-3b6afb3dabea', '3f5441d1-095e-41f6-a1dc-c099cf12e55d'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8ed9ada1-7f2c-4955-b985-f0cac629f223 tempest-VolumeQuotasAdminTestJSON-1643290160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8ed9ada1-7f2c-4955-b985-f0cac629f223 tempest-VolumeQuotasAdminTestJSON-1643290160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:20 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8ed9ada1-7f2c-4955-b985-f0cac629f223 tempest-VolumeQuotasAdminTestJSON-1643290160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:20 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8ed9ada1-7f2c-4955-b985-f0cac629f223 tempest-VolumeQuotasAdminTestJSON-1643290160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8ed9ada1-7f2c-4955-b985-f0cac629f223 tempest-VolumeQuotasAdminTestJSON-1643290160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8ed9ada1-7f2c-4955-b985-f0cac629f223 tempest-VolumeQuotasAdminTestJSON-1643290160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:20 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:06:20 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:21 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-05214c50-aa4c-416a-8cec-2245b0400e4e" returned: 0 in 0.545s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:21 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c941853-e444-4e86-9fb8-2de8625c838e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05214c50-aa4c-416a-8cec-2245b0400e4e', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445c200b-4723-41a2-9e9f-aa3ebd08be19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:21 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Volume volume-05214c50-aa4c-416a-8cec-2245b0400e4e (05214c50-aa4c-416a-8cec-2245b0400e4e): created successfully Feb 27 02:06:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445c200b-4723-41a2-9e9f-aa3ebd08be19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Flow 'volume_create_manager' (2ad355a0-0337-4d10-a881-53b4abe1a70e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:21 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-289f4913-c08e-464d-833b-e7c01d75a7f9 tempest-VolumesGetTest-1784211569 None] Created volume successfully. Feb 27 02:06:21 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8ed9ada1-7f2c-4955-b985-f0cac629f223 tempest-VolumeQuotasAdminTestJSON-1643290160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.541s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:21 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-8ed9ada1-7f2c-4955-b985-f0cac629f223 tempest-VolumeQuotasAdminTestJSON-1643290160 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:21 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-8ed9ada1-7f2c-4955-b985-f0cac629f223 tempest-VolumeQuotasAdminTestJSON-1643290160 None] Deleted volume successfully. Feb 27 02:06:21 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8ed9ada1-7f2c-4955-b985-f0cac629f223 tempest-VolumeQuotasAdminTestJSON-1643290160 None] Lock "cinder-64f580fc-9c99-4d65-9009-b4c43fc81a62-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:21 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-537f95c2-efa7-4791-b1f9-8e3a150d9c71 tempest-VolumesGetTest-1784211569 None] Acquiring lock "cinder-05214c50-aa4c-416a-8cec-2245b0400e4e-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:21 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-537f95c2-efa7-4791-b1f9-8e3a150d9c71 tempest-VolumesGetTest-1784211569 None] Lock "cinder-05214c50-aa4c-416a-8cec-2245b0400e4e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-537f95c2-efa7-4791-b1f9-8e3a150d9c71 tempest-VolumesGetTest-1784211569 None] Acquiring lock "cinder-quobyte-05214c50-aa4c-416a-8cec-2245b0400e4e" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-537f95c2-efa7-4791-b1f9-8e3a150d9c71 tempest-VolumesGetTest-1784211569 None] Lock "cinder-quobyte-05214c50-aa4c-416a-8cec-2245b0400e4e" acquired by "delete_volume" :: waited 0.019s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:22 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b3a092-fbee-4906-9790-16e297662d87]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-537f95c2-efa7-4791-b1f9-8e3a150d9c71 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-05214c50-aa4c-416a-8cec-2245b0400e4e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:22 devstack sudo[87778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-05214c50-aa4c-416a-8cec-2245b0400e4e Feb 27 02:06:22 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:22 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-537f95c2-efa7-4791-b1f9-8e3a150d9c71 tempest-VolumesGetTest-1784211569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-05214c50-aa4c-416a-8cec-2245b0400e4e" returned: 0 in 0.695s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-537f95c2-efa7-4791-b1f9-8e3a150d9c71 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-05214c50-aa4c-416a-8cec-2245b0400e4e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:22 devstack sudo[87783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-05214c50-aa4c-416a-8cec-2245b0400e4e Feb 27 02:06:22 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Flow 'volume_create_manager' (d81250c0-d477-46f1-a97a-f6c9bdb7bdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9d0001-d066-4a0c-a58d-6f8e95fd207d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9d0001-d066-4a0c-a58d-6f8e95fd207d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1831332985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e63f7d-d2a9-49be-86af-a90bd44a9500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7512e798e4424b89b78d881915da4153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:23Z,use_quota=True,user_id='6b63b77ebe3d4e09b55eb86758518964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58e654e-d1ff-4de9-a511-b17c7c9d1347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d58e654e-d1ff-4de9-a511-b17c7c9d1347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a28367-9dfe-48d1-800e-01704b538e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a28367-9dfe-48d1-800e-01704b538e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79e63f7d-d2a9-49be-86af-a90bd44a9500', 'volume_name': 'volume-79e63f7d-d2a9-49be-86af-a90bd44a9500', 'volume_size': 2}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0938064-f944-410c-b231-2e3df5fe6816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0938064-f944-410c-b231-2e3df5fe6816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3659497-2500-44d5-997c-04b024e2f732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:23 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Volume 79e63f7d-d2a9-49be-86af-a90bd44a9500: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79e63f7d-d2a9-49be-86af-a90bd44a9500', 'volume_size': 2} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1831332985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e63f7d-d2a9-49be-86af-a90bd44a9500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7512e798e4424b89b78d881915da4153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:23Z,use_quota=True,user_id='6b63b77ebe3d4e09b55eb86758518964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Creating volume 79e63f7d-d2a9-49be-86af-a90bd44a9500 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:23 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-79e63f7d-d2a9-49be-86af-a90bd44a9500 2147483648 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:23 devstack sudo[87786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-79e63f7d-d2a9-49be-86af-a90bd44a9500 2147483648 Feb 27 02:06:23 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:23 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-537f95c2-efa7-4791-b1f9-8e3a150d9c71 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-05214c50-aa4c-416a-8cec-2245b0400e4e" returned: 0 in 0.690s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-537f95c2-efa7-4791-b1f9-8e3a150d9c71 tempest-VolumesGetTest-1784211569 None] Lock "cinder-quobyte-05214c50-aa4c-416a-8cec-2245b0400e4e" released by "delete_volume" :: held 1.448s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-537f95c2-efa7-4791-b1f9-8e3a150d9c71 tempest-VolumesGetTest-1784211569 None] Created reservations ['a3c07db2-1dc9-492d-8168-bcc077ff644c', 'c28705ae-bfa2-4cc5-96e7-490d269146f1', 'fd48714b-72c6-44d7-94f0-415ea50b0ad0', 'e4ee2f7b-e907-43e4-b542-c0e185cde3cf'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-537f95c2-efa7-4791-b1f9-8e3a150d9c71 tempest-VolumesGetTest-1784211569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-537f95c2-efa7-4791-b1f9-8e3a150d9c71 tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-537f95c2-efa7-4791-b1f9-8e3a150d9c71 tempest-VolumesGetTest-1784211569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-537f95c2-efa7-4791-b1f9-8e3a150d9c71 tempest-VolumesGetTest-1784211569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-537f95c2-efa7-4791-b1f9-8e3a150d9c71 tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-537f95c2-efa7-4791-b1f9-8e3a150d9c71 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:23 devstack sudo[87788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:06:23 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:24 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-79e63f7d-d2a9-49be-86af-a90bd44a9500 2147483648" returned: 0 in 0.724s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-79e63f7d-d2a9-49be-86af-a90bd44a9500 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:24 devstack sudo[87794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-79e63f7d-d2a9-49be-86af-a90bd44a9500 Feb 27 02:06:24 devstack sudo[87794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:24 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-537f95c2-efa7-4791-b1f9-8e3a150d9c71 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.649s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:24 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-537f95c2-efa7-4791-b1f9-8e3a150d9c71 tempest-VolumesGetTest-1784211569 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:24 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-537f95c2-efa7-4791-b1f9-8e3a150d9c71 tempest-VolumesGetTest-1784211569 None] Deleted volume successfully. Feb 27 02:06:24 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-537f95c2-efa7-4791-b1f9-8e3a150d9c71 tempest-VolumesGetTest-1784211569 None] Lock "cinder-05214c50-aa4c-416a-8cec-2245b0400e4e-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:24 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b468b00b-0133-4a69-912c-cc519580b869 tempest-VolumesGetTest-1784211569 None] Acquiring lock "cinder-6d37cdb0-2dd7-42c4-9733-314064a4a1e2-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:24 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b468b00b-0133-4a69-912c-cc519580b869 tempest-VolumesGetTest-1784211569 None] Lock "cinder-6d37cdb0-2dd7-42c4-9733-314064a4a1e2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:24 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b468b00b-0133-4a69-912c-cc519580b869 tempest-VolumesGetTest-1784211569 None] Acquiring lock "cinder-quobyte-6d37cdb0-2dd7-42c4-9733-314064a4a1e2" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:24 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b468b00b-0133-4a69-912c-cc519580b869 tempest-VolumesGetTest-1784211569 None] Lock "cinder-quobyte-6d37cdb0-2dd7-42c4-9733-314064a4a1e2" acquired by "delete_volume" :: waited 0.021s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:24 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e5415f-1605-4864-8969-d91fb342e93c]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b468b00b-0133-4a69-912c-cc519580b869 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6d37cdb0-2dd7-42c4-9733-314064a4a1e2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:24 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6d37cdb0-2dd7-42c4-9733-314064a4a1e2 Feb 27 02:06:24 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:24 devstack sudo[87794]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-79e63f7d-d2a9-49be-86af-a90bd44a9500" returned: 0 in 0.635s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:24 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3659497-2500-44d5-997c-04b024e2f732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e63f7d-d2a9-49be-86af-a90bd44a9500', 'volume_size': 2}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (099f2750-c258-4b53-8d74-ae2b8b8f29b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:24 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Volume volume-79e63f7d-d2a9-49be-86af-a90bd44a9500 (79e63f7d-d2a9-49be-86af-a90bd44a9500): created successfully Feb 27 02:06:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (099f2750-c258-4b53-8d74-ae2b8b8f29b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Flow 'volume_create_manager' (d81250c0-d477-46f1-a97a-f6c9bdb7bdba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:24 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-b38c324a-6a79-4744-910d-920fc02675df tempest-VolumesCloneNegativeTest-659168894 None] Created volume successfully. Feb 27 02:06:25 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b468b00b-0133-4a69-912c-cc519580b869 tempest-VolumesGetTest-1784211569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6d37cdb0-2dd7-42c4-9733-314064a4a1e2" returned: 0 in 0.681s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b468b00b-0133-4a69-912c-cc519580b869 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6d37cdb0-2dd7-42c4-9733-314064a4a1e2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:25 devstack sudo[87804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6d37cdb0-2dd7-42c4-9733-314064a4a1e2 Feb 27 02:06:25 devstack sudo[87804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:25 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8cdfd5c0-e999-4b0d-8c71-74f0b58d8c52 tempest-VolumesCloneNegativeTest-659168894 None] Acquiring lock "cinder-79e63f7d-d2a9-49be-86af-a90bd44a9500-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:25 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8cdfd5c0-e999-4b0d-8c71-74f0b58d8c52 tempest-VolumesCloneNegativeTest-659168894 None] Lock "cinder-79e63f7d-d2a9-49be-86af-a90bd44a9500-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:25 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8cdfd5c0-e999-4b0d-8c71-74f0b58d8c52 tempest-VolumesCloneNegativeTest-659168894 None] Acquiring lock "cinder-quobyte-79e63f7d-d2a9-49be-86af-a90bd44a9500" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:25 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8cdfd5c0-e999-4b0d-8c71-74f0b58d8c52 tempest-VolumesCloneNegativeTest-659168894 None] Lock "cinder-quobyte-79e63f7d-d2a9-49be-86af-a90bd44a9500" acquired by "delete_volume" :: waited 0.016s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:25 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d1cd2a-d92e-4f42-bd65-da51c9acd0b9]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8cdfd5c0-e999-4b0d-8c71-74f0b58d8c52 tempest-VolumesCloneNegativeTest-659168894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-79e63f7d-d2a9-49be-86af-a90bd44a9500 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:25 devstack sudo[87804]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b468b00b-0133-4a69-912c-cc519580b869 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6d37cdb0-2dd7-42c4-9733-314064a4a1e2" returned: 0 in 0.657s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:25 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b468b00b-0133-4a69-912c-cc519580b869 tempest-VolumesGetTest-1784211569 None] Lock "cinder-quobyte-6d37cdb0-2dd7-42c4-9733-314064a4a1e2" released by "delete_volume" :: held 1.396s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:25 devstack sudo[87807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-79e63f7d-d2a9-49be-86af-a90bd44a9500 Feb 27 02:06:25 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:25 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-b468b00b-0133-4a69-912c-cc519580b869 tempest-VolumesGetTest-1784211569 None] Created reservations ['2ab0d339-ddb2-4fb1-b335-c9df697d6816', 'b60639d9-d698-4b09-8dfc-f6755174d399', 'c624c11c-64ea-4fe7-8ef9-74f3411c9568', '3fd79203-b134-44aa-a23c-38045ccd390b'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b468b00b-0133-4a69-912c-cc519580b869 tempest-VolumesGetTest-1784211569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b468b00b-0133-4a69-912c-cc519580b869 tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:25 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b468b00b-0133-4a69-912c-cc519580b869 tempest-VolumesGetTest-1784211569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:25 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b468b00b-0133-4a69-912c-cc519580b869 tempest-VolumesGetTest-1784211569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b468b00b-0133-4a69-912c-cc519580b869 tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b468b00b-0133-4a69-912c-cc519580b869 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:26 devstack sudo[87809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:06:26 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:26 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8cdfd5c0-e999-4b0d-8c71-74f0b58d8c52 tempest-VolumesCloneNegativeTest-659168894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-79e63f7d-d2a9-49be-86af-a90bd44a9500" returned: 0 in 0.747s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8cdfd5c0-e999-4b0d-8c71-74f0b58d8c52 tempest-VolumesCloneNegativeTest-659168894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-79e63f7d-d2a9-49be-86af-a90bd44a9500 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:26 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-79e63f7d-d2a9-49be-86af-a90bd44a9500 Feb 27 02:06:26 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:26 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b468b00b-0133-4a69-912c-cc519580b869 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.624s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:26 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-b468b00b-0133-4a69-912c-cc519580b869 tempest-VolumesGetTest-1784211569 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:26 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-b468b00b-0133-4a69-912c-cc519580b869 tempest-VolumesGetTest-1784211569 None] Deleted volume successfully. Feb 27 02:06:26 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b468b00b-0133-4a69-912c-cc519580b869 tempest-VolumesGetTest-1784211569 None] Lock "cinder-6d37cdb0-2dd7-42c4-9733-314064a4a1e2-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:27 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8cdfd5c0-e999-4b0d-8c71-74f0b58d8c52 tempest-VolumesCloneNegativeTest-659168894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-79e63f7d-d2a9-49be-86af-a90bd44a9500" returned: 0 in 0.699s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8cdfd5c0-e999-4b0d-8c71-74f0b58d8c52 tempest-VolumesCloneNegativeTest-659168894 None] Lock "cinder-quobyte-79e63f7d-d2a9-49be-86af-a90bd44a9500" released by "delete_volume" :: held 1.473s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Flow 'volume_create_manager' (db03aa9d-c8b4-43d5-afb9-28930dcee35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6871d40-ef47-4131-be5a-2e46a6b880d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-8cdfd5c0-e999-4b0d-8c71-74f0b58d8c52 tempest-VolumesCloneNegativeTest-659168894 None] Created reservations ['88b83483-d217-445a-ad16-346564f98a2b', '0d074d81-90ba-4939-bb5c-bb27fe191225', '55570a09-61eb-483d-8daa-fd2dd7b28ae1', 'c07216cd-bf48-42c2-b9e7-6b93a2c2e851'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6871d40-ef47-4131-be5a-2e46a6b880d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-710817436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc00684-a3e8-41ea-b262-d508dba6523b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07111062ffc436da7aa27ae6d219d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:27Z,use_quota=True,user_id='ee4a42c7c9a24aad92ddd645d91b635d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74e7901-73a8-49ef-ac4f-c1a37683c675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74e7901-73a8-49ef-ac4f-c1a37683c675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c745e6-f83b-4590-b16b-e82cae374a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c745e6-f83b-4590-b16b-e82cae374a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cc00684-a3e8-41ea-b262-d508dba6523b', 'volume_name': 'volume-0cc00684-a3e8-41ea-b262-d508dba6523b', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd13f85b-5744-430d-aa91-4621a76449d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd13f85b-5744-430d-aa91-4621a76449d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3006d57a-f55a-41a3-b027-0eb7eac78996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:27 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Volume 0cc00684-a3e8-41ea-b262-d508dba6523b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cc00684-a3e8-41ea-b262-d508dba6523b', 'volume_size': 1} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-710817436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc00684-a3e8-41ea-b262-d508dba6523b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07111062ffc436da7aa27ae6d219d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:27Z,use_quota=True,user_id='ee4a42c7c9a24aad92ddd645d91b635d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Creating volume 0cc00684-a3e8-41ea-b262-d508dba6523b {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:27 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:27 devstack sudo[87818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b 1073741824 Feb 27 02:06:27 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8cdfd5c0-e999-4b0d-8c71-74f0b58d8c52 tempest-VolumesCloneNegativeTest-659168894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8cdfd5c0-e999-4b0d-8c71-74f0b58d8c52 tempest-VolumesCloneNegativeTest-659168894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8cdfd5c0-e999-4b0d-8c71-74f0b58d8c52 tempest-VolumesCloneNegativeTest-659168894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8cdfd5c0-e999-4b0d-8c71-74f0b58d8c52 tempest-VolumesCloneNegativeTest-659168894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8cdfd5c0-e999-4b0d-8c71-74f0b58d8c52 tempest-VolumesCloneNegativeTest-659168894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8cdfd5c0-e999-4b0d-8c71-74f0b58d8c52 tempest-VolumesCloneNegativeTest-659168894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:27 devstack sudo[87820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:06:27 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:27 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8cdfd5c0-e999-4b0d-8c71-74f0b58d8c52 tempest-VolumesCloneNegativeTest-659168894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.555s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:27 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-8cdfd5c0-e999-4b0d-8c71-74f0b58d8c52 tempest-VolumesCloneNegativeTest-659168894 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:27 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-8cdfd5c0-e999-4b0d-8c71-74f0b58d8c52 tempest-VolumesCloneNegativeTest-659168894 None] Deleted volume successfully. Feb 27 02:06:28 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8cdfd5c0-e999-4b0d-8c71-74f0b58d8c52 tempest-VolumesCloneNegativeTest-659168894 None] Lock "cinder-79e63f7d-d2a9-49be-86af-a90bd44a9500-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:28 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b 1073741824" returned: 0 in 0.764s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:28 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b Feb 27 02:06:28 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:28 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b" returned: 0 in 0.781s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:28 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:28 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3006d57a-f55a-41a3-b027-0eb7eac78996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cc00684-a3e8-41ea-b262-d508dba6523b', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:28 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993d45eb-c07c-462b-ae7b-bbfc12943938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:28 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Volume volume-0cc00684-a3e8-41ea-b262-d508dba6523b (0cc00684-a3e8-41ea-b262-d508dba6523b): created successfully Feb 27 02:06:28 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993d45eb-c07c-462b-ae7b-bbfc12943938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:28 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Flow 'volume_create_manager' (db03aa9d-c8b4-43d5-afb9-28930dcee35c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:29 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-992f66c4-bab3-4dcf-8f8d-58bccfcab5b6 tempest-VolumesGetTest-1784211569 None] Created volume successfully. Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Flow 'volume_create_manager' (18ed42b1-b3bc-4277-98f1-5cb70cdac859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d07759-2c72-4dc5-9956-341d00b40577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d07759-2c72-4dc5-9956-341d00b40577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1739895187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a6d33a-249b-4500-8e86-fed134105c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a7946c3ca3491f9fe45eeb15230b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:29Z,use_quota=True,user_id='c1532a5c1d62485fa1e096d94c739b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1521d899-406c-46c2-b9fb-8eed2b1e8666),volume_type_id=1521d899-406c-46c2-b9fb-8eed2b1e8666)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02202f0e-6ab9-4627-8940-7c86d923b956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02202f0e-6ab9-4627-8940-7c86d923b956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61925b88-9776-4250-8ca8-b2f928eac5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61925b88-9776-4250-8ca8-b2f928eac5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a6d33a-249b-4500-8e86-fed134105c63', 'volume_name': 'volume-82a6d33a-249b-4500-8e86-fed134105c63', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49173ece-f08b-47ab-9bb6-3165452f8398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49173ece-f08b-47ab-9bb6-3165452f8398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d9fa62-58b0-4417-8961-2f547d065e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:29 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Volume 82a6d33a-249b-4500-8e86-fed134105c63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a6d33a-249b-4500-8e86-fed134105c63', 'volume_size': 1} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1739895187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a6d33a-249b-4500-8e86-fed134105c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a7946c3ca3491f9fe45eeb15230b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:29Z,use_quota=True,user_id='c1532a5c1d62485fa1e096d94c739b3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1521d899-406c-46c2-b9fb-8eed2b1e8666),volume_type_id=1521d899-406c-46c2-b9fb-8eed2b1e8666)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Creating volume 82a6d33a-249b-4500-8e86-fed134105c63 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:29 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-82a6d33a-249b-4500-8e86-fed134105c63 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:29 devstack sudo[87830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-82a6d33a-249b-4500-8e86-fed134105c63 1073741824 Feb 27 02:06:29 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Flow 'volume_create_manager' (f1643e29-61ee-4bff-8dc0-f8b883d49a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3557fa-db74-47cc-9231-d30cd0133ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3557fa-db74-47cc-9231-d30cd0133ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-253195352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28482016-ca49-440c-b7b1-6422dafa5b0d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e07111062ffc436da7aa27ae6d219d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0cc00684-a3e8-41ea-b262-d508dba6523b,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:30Z,use_quota=True,user_id='ee4a42c7c9a24aad92ddd645d91b635d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fcb189b-83a1-454f-adde-05c336eb5a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fcb189b-83a1-454f-adde-05c336eb5a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cf1682-3bf0-4151-96ed-4b2c36dee843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cf1682-3bf0-4151-96ed-4b2c36dee843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '28482016-ca49-440c-b7b1-6422dafa5b0d', 'volume_name': 'volume-28482016-ca49-440c-b7b1-6422dafa5b0d', 'volume_size': 1, 'source_volid': '0cc00684-a3e8-41ea-b262-d508dba6523b', 'source_volstatus': 'available'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c61310-b2d9-4938-a7a5-202860dfb4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c61310-b2d9-4938-a7a5-202860dfb4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e691b669-7a2d-46b2-bb15-732bebb13f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:29 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Volume 28482016-ca49-440c-b7b1-6422dafa5b0d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-28482016-ca49-440c-b7b1-6422dafa5b0d', 'volume_size': 1, 'source_volid': '0cc00684-a3e8-41ea-b262-d508dba6523b', 'source_volstatus': 'available'} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:29 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-82a6d33a-249b-4500-8e86-fed134105c63 1073741824" returned: 0 in 0.750s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-82a6d33a-249b-4500-8e86-fed134105c63 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:30 devstack sudo[87835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-82a6d33a-249b-4500-8e86-fed134105c63 Feb 27 02:06:30 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:30 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-82a6d33a-249b-4500-8e86-fed134105c63" returned: 0 in 0.564s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.692s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:30 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Cloning volume 0cc00684-a3e8-41ea-b262-d508dba6523b to volume 28482016-ca49-440c-b7b1-6422dafa5b0d Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d9fa62-58b0-4417-8961-2f547d065e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a6d33a-249b-4500-8e86-fed134105c63', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b6e285-b10d-45c6-a34b-821e40def208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:30 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Volume volume-82a6d33a-249b-4500-8e86-fed134105c63 (82a6d33a-249b-4500-8e86-fed134105c63): created successfully Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b6e285-b10d-45c6-a34b-821e40def208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Flow 'volume_create_manager' (18ed42b1-b3bc-4277-98f1-5cb70cdac859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:30 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-d4f3753b-d8ab-4b9d-811e-795290d1661b tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Created volume successfully. Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Creating offline snapshot 40bc6b87-7d27-4368-a15a-7b309fb3aa70 of volume 0cc00684-a3e8-41ea-b262-d508dba6523b {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54806b8-9c1d-4cf2-8ca5-fd34437e9a07]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:30 devstack sudo[87838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b Feb 27 02:06:30 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Flow 'volume_create_manager' (86146730-c270-4fd0-a7a1-b19c8ff778aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2cef44-c412-4f63-a6ca-fa383a8a847b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2cef44-c412-4f63-a6ca-fa383a8a847b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1024484094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8bef1f-c17c-459c-be72-21eb1d4211ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6870d7847f2d4f08b6468ed08c46343a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:31Z,use_quota=True,user_id='137cb9d56945475aad603a475606dc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be850423-b9a9-4223-8f0c-cc3f0b230f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be850423-b9a9-4223-8f0c-cc3f0b230f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232a7d69-f42c-4e32-94d4-48a991d8e309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232a7d69-f42c-4e32-94d4-48a991d8e309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e8bef1f-c17c-459c-be72-21eb1d4211ca', 'volume_name': 'volume-3e8bef1f-c17c-459c-be72-21eb1d4211ca', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23005f09-bdd1-4d23-9665-c53656f5b3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23005f09-bdd1-4d23-9665-c53656f5b3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e5437b-085f-4321-8359-a34b424a29ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:30 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Volume 3e8bef1f-c17c-459c-be72-21eb1d4211ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e8bef1f-c17c-459c-be72-21eb1d4211ca', 'volume_size': 1} Feb 27 02:06:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Flow 'volume_create_manager' (cc77d227-52b2-4112-9c46-a9cc961ec2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d454e8c-d637-4f99-ba44-b6c723a3260f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d454e8c-d637-4f99-ba44-b6c723a3260f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1637486622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b8287b0-de4c-49ec-8fd9-a28a752253c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6870d7847f2d4f08b6468ed08c46343a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:31Z,use_quota=True,user_id='137cb9d56945475aad603a475606dc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00284315-8bd1-4089-988f-7ce22303b99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00284315-8bd1-4089-988f-7ce22303b99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13182d4-f86e-4f79-8c83-33be389a196e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13182d4-f86e-4f79-8c83-33be389a196e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b8287b0-de4c-49ec-8fd9-a28a752253c4', 'volume_name': 'volume-7b8287b0-de4c-49ec-8fd9-a28a752253c4', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efaf5125-2d3a-472b-a241-e49627436941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efaf5125-2d3a-472b-a241-e49627436941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c01dbaa-5bd2-49ed-8315-841fdb03e107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:31 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Volume 7b8287b0-de4c-49ec-8fd9-a28a752253c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b8287b0-de4c-49ec-8fd9-a28a752253c4', 'volume_size': 1} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:31 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b" returned: 0 in 0.789s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:31 devstack sudo[87844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70 1G Feb 27 02:06:31 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Flow 'volume_create_manager' (a7fab90d-7d57-483e-afac-a30505c4f4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3569028d-c182-4d53-b5b5-987bcc43f68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3569028d-c182-4d53-b5b5-987bcc43f68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1406015390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada90d79-96c4-4e94-b85f-df3952621b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6870d7847f2d4f08b6468ed08c46343a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:31Z,use_quota=True,user_id='137cb9d56945475aad603a475606dc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dacc3d3-dc0b-4a4f-994c-0d4a1efe1a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dacc3d3-dc0b-4a4f-994c-0d4a1efe1a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a9e674-1376-4197-9b04-155f7f8ae98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a9e674-1376-4197-9b04-155f7f8ae98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada90d79-96c4-4e94-b85f-df3952621b58', 'volume_name': 'volume-ada90d79-96c4-4e94-b85f-df3952621b58', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9508b7-1fef-40aa-83e8-e5974ade5a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9508b7-1fef-40aa-83e8-e5974ade5a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c197f39e-71b7-46e6-9e11-1abeb67da6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:31 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Volume ada90d79-96c4-4e94-b85f-df3952621b58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada90d79-96c4-4e94-b85f-df3952621b58', 'volume_size': 1} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Flow 'volume_create_manager' (e0179a64-113c-427e-abf4-b27b3de06d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8840fbe2-f2a8-4979-b042-7df1d8d3436c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8840fbe2-f2a8-4979-b042-7df1d8d3436c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1957528311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676731a6-6f29-4892-be37-c5021b866a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6870d7847f2d4f08b6468ed08c46343a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:32Z,use_quota=True,user_id='137cb9d56945475aad603a475606dc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1b5ca1-bd26-444d-9663-25b8a75cb4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1b5ca1-bd26-444d-9663-25b8a75cb4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84540266-ab58-41c8-a95d-cd2404c4104c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84540266-ab58-41c8-a95d-cd2404c4104c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '676731a6-6f29-4892-be37-c5021b866a30', 'volume_name': 'volume-676731a6-6f29-4892-be37-c5021b866a30', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21f1b1e-82ff-47ec-834b-e45b2caebfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21f1b1e-82ff-47ec-834b-e45b2caebfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efeb1bd8-b846-483f-a63c-b7a03e4bed72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:31 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Volume 676731a6-6f29-4892-be37-c5021b866a30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-676731a6-6f29-4892-be37-c5021b866a30', 'volume_size': 1} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3916974b-5eab-4b19-b542-d0ec816bdf06 tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3916974b-5eab-4b19-b542-d0ec816bdf06 tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-3916974b-5eab-4b19-b542-d0ec816bdf06 tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-3916974b-5eab-4b19-b542-d0ec816bdf06 tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3916974b-5eab-4b19-b542-d0ec816bdf06 tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3916974b-5eab-4b19-b542-d0ec816bdf06 tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:31 devstack sudo[87846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:06:31 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Flow 'volume_create_manager' (a53fb509-f3cf-485c-aa8a-299a93f06c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ded03f-bfcc-4238-8505-7962076d5bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ded03f-bfcc-4238-8505-7962076d5bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1492264832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b833b4-2677-4471-b823-3cf9364247f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6870d7847f2d4f08b6468ed08c46343a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:32Z,use_quota=True,user_id='137cb9d56945475aad603a475606dc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02802279-485f-4650-b8b3-aa478b642c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02802279-485f-4650-b8b3-aa478b642c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18091bec-d80d-433b-9c76-2f92b21a1ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18091bec-d80d-433b-9c76-2f92b21a1ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45b833b4-2677-4471-b823-3cf9364247f6', 'volume_name': 'volume-45b833b4-2677-4471-b823-3cf9364247f6', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a5a5aa-de40-4d5a-8d0d-f8b8ad9e62e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a5a5aa-de40-4d5a-8d0d-f8b8ad9e62e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef6b0af-902c-42bf-a904-3c63998ee64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:32 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Volume 45b833b4-2677-4471-b823-3cf9364247f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45b833b4-2677-4471-b823-3cf9364247f6', 'volume_size': 1} Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:32 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70 1G" returned: 0 in 0.749s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc00684-a3e8-41ea-b262-d508dba6523b -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:32 devstack sudo[87851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc00684-a3e8-41ea-b262-d508dba6523b -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70 Feb 27 02:06:32 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:32 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3916974b-5eab-4b19-b542-d0ec816bdf06 tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.593s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-3916974b-5eab-4b19-b542-d0ec816bdf06 tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:32 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-3916974b-5eab-4b19-b542-d0ec816bdf06 tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Retype volume completed successfully. Feb 27 02:06:32 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc00684-a3e8-41ea-b262-d508dba6523b -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70" returned: 0 in 0.557s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:32 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70 is being set with open permissions: ugo+rw Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:32 devstack sudo[87857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70 Feb 27 02:06:32 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Acquiring lock "cinder-82a6d33a-249b-4500-8e86-fed134105c63-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Lock "cinder-82a6d33a-249b-4500-8e86-fed134105c63-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Acquiring lock "cinder-quobyte-82a6d33a-249b-4500-8e86-fed134105c63" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Lock "cinder-quobyte-82a6d33a-249b-4500-8e86-fed134105c63" acquired by "delete_volume" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7b3526-47b4-4d72-bf3c-3b606d90e9f0]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-82a6d33a-249b-4500-8e86-fed134105c63 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:32 devstack sudo[87859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-82a6d33a-249b-4500-8e86-fed134105c63 Feb 27 02:06:32 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:33 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Flow 'volume_create_manager' (b741dd33-8c14-44b0-b827-d774adb4b21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc35c7a-322a-4703-a09f-452e40d35020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc35c7a-322a-4703-a09f-452e40d35020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-815375726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eddcf77d-1ccd-4ff1-9e67-626b04020ff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08f7ec019d043979d16317fe8a50af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:33Z,use_quota=True,user_id='2a7391c6e38d4bcc86deb7de2494787e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c664f505-6571-4a18-bb79-c9781dbf2bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c664f505-6571-4a18-bb79-c9781dbf2bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fcc303f-e177-44f0-8483-44e2f4b3c8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fcc303f-e177-44f0-8483-44e2f4b3c8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eddcf77d-1ccd-4ff1-9e67-626b04020ff5', 'volume_name': 'volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9deac92-3ab7-4b27-ae21-c3f29b720ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9deac92-3ab7-4b27-ae21-c3f29b720ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f79539-b708-4f1b-9c1e-797b9e5d0e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:33 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Volume eddcf77d-1ccd-4ff1-9e67-626b04020ff5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5', 'volume_size': 1} Feb 27 02:06:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:33 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70" returned: 0 in 0.490s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:33 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.info Feb 27 02:06:33 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:33 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-82a6d33a-249b-4500-8e86-fed134105c63" returned: 0 in 0.584s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-82a6d33a-249b-4500-8e86-fed134105c63 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:33 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-82a6d33a-249b-4500-8e86-fed134105c63 Feb 27 02:06:33 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:33 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.info" returned: 0 in 0.470s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:33 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.info is being set with open permissions: ugo+rw Feb 27 02:06:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:33 devstack sudo[87870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.info Feb 27 02:06:33 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:33 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-82a6d33a-249b-4500-8e86-fed134105c63" returned: 0 in 0.478s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Lock "cinder-quobyte-82a6d33a-249b-4500-8e86-fed134105c63" released by "delete_volume" :: held 1.094s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:33 devstack cinder-volume[82683]: WARNING cinder.quota [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:06:33 devstack cinder-volume[82683]: WARNING cinder.quota [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Created reservations ['e515ffd5-eb41-4139-99ef-e2e95b052ba7', 'e04a1336-f1ba-44df-9227-17e6fdc894bd', 'c041fa78-8229-4cb6-b9bd-caa15a92d8f0', 'b8fe7941-a107-41fc-9c6b-fd990910cb75'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:34 devstack sudo[87873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:06:34 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:34 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.info" returned: 0 in 0.503s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Acquiring lock "cinder-quobyte-28482016-ca49-440c-b7b1-6422dafa5b0d" by "_copy_volume_from_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Lock "cinder-quobyte-28482016-ca49-440c-b7b1-6422dafa5b0d" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] snapshot: 40bc6b87-7d27-4368-a15a-7b309fb3aa70, volume: 28482016-ca49-440c-b7b1-6422dafa5b0d, {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed693de-348c-4b95-b1cc-56d31e80386f]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:34 devstack sudo[87876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70 Feb 27 02:06:34 devstack sudo[87876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:34 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.456s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:34 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Deleted volume successfully. Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1a08b0c9-cc6d-419a-9d57-558c3fac29af tempest-VolumeRetypeWithoutMigrationTest-1234679682 None] Lock "cinder-82a6d33a-249b-4500-8e86-fed134105c63-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:34 devstack sudo[87876]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70" returned: 0 in 0.508s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc00684-a3e8-41ea-b262-d508dba6523b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] will copy from snapshot at /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Creating direct copy from snapshot {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4848d5c-6163-4f90-b3e3-4969f6a61f15]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:34 devstack sudo[87882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b Feb 27 02:06:34 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:35 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b" returned: 0 in 0.627s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:35 devstack cinder-volume[82683]: DEBUG cinder.utils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Path /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-28482016-ca49-440c-b7b1-6422dafa5b0d not found in is_blk_device check {{(pid=82683) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:06:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-28482016-ca49-440c-b7b1-6422dafa5b0d {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:35 devstack sudo[87887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-28482016-ca49-440c-b7b1-6422dafa5b0d Feb 27 02:06:35 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:38 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-28482016-ca49-440c-b7b1-6422dafa5b0d" returned: 0 in 2.620s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:38 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb661a9-848a-4839-97c3-2fa104548884]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:38 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b Feb 27 02:06:38 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:38 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b" returned: 0 in 0.697s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:38 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Image conversion details: src /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b, size 1024.00 MB, duration 2.62 sec, destination /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-28482016-ca49-440c-b7b1-6422dafa5b0d {{(pid=82683) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:06:38 devstack cinder-volume[82683]: INFO cinder.image.image_utils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Converted 1024.00 MB image at 390.70 MB/s Feb 27 02:06:38 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-28482016-ca49-440c-b7b1-6422dafa5b0d is being set with open permissions: ugo+rw Feb 27 02:06:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-28482016-ca49-440c-b7b1-6422dafa5b0d {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:38 devstack sudo[87906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-28482016-ca49-440c-b7b1-6422dafa5b0d Feb 27 02:06:38 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:39 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-28482016-ca49-440c-b7b1-6422dafa5b0d" returned: 0 in 0.469s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:39 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Lock "cinder-quobyte-28482016-ca49-440c-b7b1-6422dafa5b0d" released by "_copy_volume_from_snapshot" :: held 4.992s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:39 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Acquiring lock "cinder-quobyte-40bc6b87-7d27-4368-a15a-7b309fb3aa70" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:39 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Lock "cinder-quobyte-40bc6b87-7d27-4368-a15a-7b309fb3aa70" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:39 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Deleting offline snapshot 40bc6b87-7d27-4368-a15a-7b309fb3aa70 of volume 0cc00684-a3e8-41ea-b262-d508dba6523b {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:06:39 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] snapshot_file for this snap is: volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:06:39 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d507b0-563e-4033-b550-cb8e27dcac53]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:39 devstack sudo[87909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70 Feb 27 02:06:39 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:39 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70" returned: 0 in 0.587s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:39 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc00684-a3e8-41ea-b262-d508dba6523b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:39 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[322ebaf0-fa5d-4324-b26a-9737302f172b]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:40 devstack sudo[87914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b Feb 27 02:06:40 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:40 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b" returned: 0 in 0.602s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:40 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70 Feb 27 02:06:40 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:41 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70" returned: 0 in 0.634s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:41 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70 Feb 27 02:06:41 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:41 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b.40bc6b87-7d27-4368-a15a-7b309fb3aa70" returned: 0 in 0.521s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Lock "cinder-quobyte-40bc6b87-7d27-4368-a15a-7b309fb3aa70" released by "_delete_snapshot" :: held 2.404s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.172s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.790s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:41 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1024484094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8bef1f-c17c-459c-be72-21eb1d4211ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6870d7847f2d4f08b6468ed08c46343a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:31Z,use_quota=True,user_id='137cb9d56945475aad603a475606dc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:41 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Creating volume 3e8bef1f-c17c-459c-be72-21eb1d4211ca {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:41 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:41 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:41 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:41 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:06:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e8bef1f-c17c-459c-be72-21eb1d4211ca 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e691b669-7a2d-46b2-bb15-732bebb13f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28482016-ca49-440c-b7b1-6422dafa5b0d', 'volume_size': 1, 'source_volid': '0cc00684-a3e8-41ea-b262-d508dba6523b', 'source_volstatus': 'available'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c61080-d0e6-4f35-8c6d-39e00e63f00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:41 devstack sudo[87927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e8bef1f-c17c-459c-be72-21eb1d4211ca 1073741824 Feb 27 02:06:41 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:41 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Volume volume-28482016-ca49-440c-b7b1-6422dafa5b0d (28482016-ca49-440c-b7b1-6422dafa5b0d): created successfully Feb 27 02:06:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c61080-d0e6-4f35-8c6d-39e00e63f00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Flow 'volume_create_manager' (f1643e29-61ee-4bff-8dc0-f8b883d49a18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:41 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-1739390f-a30c-494b-83f2-6a0e86bb5a44 tempest-VolumesGetTest-1784211569 None] Created volume successfully. Feb 27 02:06:42 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e8bef1f-c17c-459c-be72-21eb1d4211ca 1073741824" returned: 0 in 0.684s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e8bef1f-c17c-459c-be72-21eb1d4211ca {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:42 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e8bef1f-c17c-459c-be72-21eb1d4211ca Feb 27 02:06:42 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:43 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e8bef1f-c17c-459c-be72-21eb1d4211ca" returned: 0 in 0.630s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.857s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1637486622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b8287b0-de4c-49ec-8fd9-a28a752253c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6870d7847f2d4f08b6468ed08c46343a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:31Z,use_quota=True,user_id='137cb9d56945475aad603a475606dc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Creating volume 7b8287b0-de4c-49ec-8fd9-a28a752253c4 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:43 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7b8287b0-de4c-49ec-8fd9-a28a752253c4 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e5437b-085f-4321-8359-a34b424a29ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e8bef1f-c17c-459c-be72-21eb1d4211ca', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:43 devstack sudo[87935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7b8287b0-de4c-49ec-8fd9-a28a752253c4 1073741824 Feb 27 02:06:43 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2bf2075-2d1e-4e7d-abb7-867c8e88cc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:43 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Volume volume-3e8bef1f-c17c-459c-be72-21eb1d4211ca (3e8bef1f-c17c-459c-be72-21eb1d4211ca): created successfully Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2bf2075-2d1e-4e7d-abb7-867c8e88cc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Flow 'volume_create_manager' (86146730-c270-4fd0-a7a1-b19c8ff778aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:43 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-05349527-20b3-4f1e-bdff-5cd70cc32fce tempest-CreateVolumesFromImageTest-681433369 None] Created volume successfully. Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Flow 'volume_create_manager' (d72f0812-d9ea-407b-ae0d-93b2bfc6a73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d974fe64-10ce-4dd7-be17-d8b3130f1334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d974fe64-10ce-4dd7-be17-d8b3130f1334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-913219117',display_name='tempest-VolumesGetTest-Volume-1656612995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08db82c-9dcd-43ef-aa6a-4d5a616683d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07111062ffc436da7aa27ae6d219d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:43Z,use_quota=True,user_id='ee4a42c7c9a24aad92ddd645d91b635d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c04ae1-4197-4f24-970f-c808ecfa7856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c04ae1-4197-4f24-970f-c808ecfa7856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71475d48-d0e4-4823-8652-c2c0c084f55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71475d48-d0e4-4823-8652-c2c0c084f55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b08db82c-9dcd-43ef-aa6a-4d5a616683d9', 'volume_name': 'volume-b08db82c-9dcd-43ef-aa6a-4d5a616683d9', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8239029a-9d94-4a6d-8466-b6e5d51765ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8239029a-9d94-4a6d-8466-b6e5d51765ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77302e49-e863-4e12-b1f9-40023ba35150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:43 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Volume b08db82c-9dcd-43ef-aa6a-4d5a616683d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b08db82c-9dcd-43ef-aa6a-4d5a616683d9', 'volume_size': 1} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:43 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7b8287b0-de4c-49ec-8fd9-a28a752253c4 1073741824" returned: 0 in 0.670s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7b8287b0-de4c-49ec-8fd9-a28a752253c4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:43 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7b8287b0-de4c-49ec-8fd9-a28a752253c4 Feb 27 02:06:43 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:44 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7b8287b0-de4c-49ec-8fd9-a28a752253c4" returned: 0 in 0.529s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.697s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1406015390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada90d79-96c4-4e94-b85f-df3952621b58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6870d7847f2d4f08b6468ed08c46343a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:31Z,use_quota=True,user_id='137cb9d56945475aad603a475606dc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Creating volume ada90d79-96c4-4e94-b85f-df3952621b58 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:44 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ada90d79-96c4-4e94-b85f-df3952621b58 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c01dbaa-5bd2-49ed-8315-841fdb03e107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b8287b0-de4c-49ec-8fd9-a28a752253c4', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d9b94c1-883c-4451-88ba-cda3048776de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:44 devstack sudo[87943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ada90d79-96c4-4e94-b85f-df3952621b58 1073741824 Feb 27 02:06:44 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:44 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Volume volume-7b8287b0-de4c-49ec-8fd9-a28a752253c4 (7b8287b0-de4c-49ec-8fd9-a28a752253c4): created successfully Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d9b94c1-883c-4451-88ba-cda3048776de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Flow 'volume_create_manager' (cc77d227-52b2-4112-9c46-a9cc961ec2e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:44 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-5f616ff7-6e39-4963-a12b-134586b6d97c tempest-CreateVolumesFromImageTest-681433369 None] Created volume successfully. Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Flow 'volume_create_manager' (cec2b152-09ce-4c6c-8738-4949364e968e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb9c5c6-82e0-4500-8636-a941c9abedd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb9c5c6-82e0-4500-8636-a941c9abedd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-949191477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f55124-ac89-44b7-94c1-c4f098e0593a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='387a3ae2ee10446fa13768105c34fd7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:45Z,use_quota=True,user_id='9527a9ffa7b845cc92b823b33e1dbdce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2908e420-9a79-4368-9c97-e00c06b83baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2908e420-9a79-4368-9c97-e00c06b83baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f9e054-cacc-4881-95ce-55321fdf489b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f9e054-cacc-4881-95ce-55321fdf489b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03f55124-ac89-44b7-94c1-c4f098e0593a', 'volume_name': 'volume-03f55124-ac89-44b7-94c1-c4f098e0593a', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44adcc5d-3b50-48d6-b9df-1bea6c9658b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44adcc5d-3b50-48d6-b9df-1bea6c9658b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6bdda36-7cb7-4d50-b086-f8ca22262de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:44 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Volume 03f55124-ac89-44b7-94c1-c4f098e0593a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03f55124-ac89-44b7-94c1-c4f098e0593a', 'volume_size': 1} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:44 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ada90d79-96c4-4e94-b85f-df3952621b58 1073741824" returned: 0 in 0.588s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ada90d79-96c4-4e94-b85f-df3952621b58 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:44 devstack sudo[87948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ada90d79-96c4-4e94-b85f-df3952621b58 Feb 27 02:06:44 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:45 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ada90d79-96c4-4e94-b85f-df3952621b58" returned: 0 in 0.444s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.566s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1957528311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676731a6-6f29-4892-be37-c5021b866a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6870d7847f2d4f08b6468ed08c46343a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:32Z,use_quota=True,user_id='137cb9d56945475aad603a475606dc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Creating volume 676731a6-6f29-4892-be37-c5021b866a30 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:45 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:06:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-676731a6-6f29-4892-be37-c5021b866a30 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c197f39e-71b7-46e6-9e11-1abeb67da6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada90d79-96c4-4e94-b85f-df3952621b58', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e5c0a7-5186-4585-b0bb-e04de76684d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:45 devstack sudo[87951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-676731a6-6f29-4892-be37-c5021b866a30 1073741824 Feb 27 02:06:45 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:45 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Volume volume-ada90d79-96c4-4e94-b85f-df3952621b58 (ada90d79-96c4-4e94-b85f-df3952621b58): created successfully Feb 27 02:06:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e5c0a7-5186-4585-b0bb-e04de76684d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Flow 'volume_create_manager' (a7fab90d-7d57-483e-afac-a30505c4f4a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:45 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-116159cc-2a30-4ca2-b0ca-4d4ddc0c7ccd tempest-CreateVolumesFromImageTest-681433369 None] Created volume successfully. Feb 27 02:06:45 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-676731a6-6f29-4892-be37-c5021b866a30 1073741824" returned: 0 in 0.556s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-676731a6-6f29-4892-be37-c5021b866a30 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:46 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-676731a6-6f29-4892-be37-c5021b866a30 Feb 27 02:06:46 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:46 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-676731a6-6f29-4892-be37-c5021b866a30" returned: 0 in 0.524s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.351s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1492264832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b833b4-2677-4471-b823-3cf9364247f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6870d7847f2d4f08b6468ed08c46343a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:32Z,use_quota=True,user_id='137cb9d56945475aad603a475606dc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Creating volume 45b833b4-2677-4471-b823-3cf9364247f6 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:46 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:06:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-45b833b4-2677-4471-b823-3cf9364247f6 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:46 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efeb1bd8-b846-483f-a63c-b7a03e4bed72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-676731a6-6f29-4892-be37-c5021b866a30', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:46 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0781d34f-e107-4c6d-9c5a-f231f685c3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:46 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-45b833b4-2677-4471-b823-3cf9364247f6 1073741824 Feb 27 02:06:46 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:46 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Volume volume-676731a6-6f29-4892-be37-c5021b866a30 (676731a6-6f29-4892-be37-c5021b866a30): created successfully Feb 27 02:06:46 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0781d34f-e107-4c6d-9c5a-f231f685c3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:46 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Flow 'volume_create_manager' (e0179a64-113c-427e-abf4-b27b3de06d64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:46 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-55c6476d-2af1-40f8-ba45-f59b2ef66fae tempest-CreateVolumesFromImageTest-681433369 None] Created volume successfully. Feb 27 02:06:47 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-45b833b4-2677-4471-b823-3cf9364247f6 1073741824" returned: 0 in 0.555s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-45b833b4-2677-4471-b823-3cf9364247f6 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:47 devstack sudo[87964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-45b833b4-2677-4471-b823-3cf9364247f6 Feb 27 02:06:47 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:47 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-45b833b4-2677-4471-b823-3cf9364247f6" returned: 0 in 0.461s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:47 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.536s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:47 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-815375726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eddcf77d-1ccd-4ff1-9e67-626b04020ff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08f7ec019d043979d16317fe8a50af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:33Z,use_quota=True,user_id='2a7391c6e38d4bcc86deb7de2494787e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:47 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Creating volume eddcf77d-1ccd-4ff1-9e67-626b04020ff5 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:47 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:47 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:47 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:47 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:06:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:47 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef6b0af-902c-42bf-a904-3c63998ee64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45b833b4-2677-4471-b823-3cf9364247f6', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:47 devstack sudo[87967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5 1073741824 Feb 27 02:06:47 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:47 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fe3902-59e2-4458-a4db-c68a12ef81aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:47 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Volume volume-45b833b4-2677-4471-b823-3cf9364247f6 (45b833b4-2677-4471-b823-3cf9364247f6): created successfully Feb 27 02:06:47 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fe3902-59e2-4458-a4db-c68a12ef81aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:47 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Flow 'volume_create_manager' (a53fb509-f3cf-485c-aa8a-299a93f06c8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:47 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-505bb03a-eb32-4e80-a6d0-385338178537 tempest-CreateVolumesFromImageTest-681433369 None] Created volume successfully. Feb 27 02:06:48 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5 1073741824" returned: 0 in 0.585s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:48 devstack sudo[87973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5 Feb 27 02:06:48 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4b001887-b06f-4034-ada2-8789bf582b14 tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "cinder-45b833b4-2677-4471-b823-3cf9364247f6-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4b001887-b06f-4034-ada2-8789bf582b14 tempest-CreateVolumesFromImageTest-681433369 None] Lock "cinder-45b833b4-2677-4471-b823-3cf9364247f6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4b001887-b06f-4034-ada2-8789bf582b14 tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "cinder-quobyte-45b833b4-2677-4471-b823-3cf9364247f6" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4b001887-b06f-4034-ada2-8789bf582b14 tempest-CreateVolumesFromImageTest-681433369 None] Lock "cinder-quobyte-45b833b4-2677-4471-b823-3cf9364247f6" acquired by "delete_volume" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae7ded4-8b7d-4fd9-aba7-49c052366d46]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b001887-b06f-4034-ada2-8789bf582b14 tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-45b833b4-2677-4471-b823-3cf9364247f6 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:48 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5" returned: 0 in 0.551s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.506s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-913219117',display_name='tempest-VolumesGetTest-Volume-1656612995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b08db82c-9dcd-43ef-aa6a-4d5a616683d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07111062ffc436da7aa27ae6d219d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:43Z,use_quota=True,user_id='ee4a42c7c9a24aad92ddd645d91b635d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Creating volume b08db82c-9dcd-43ef-aa6a-4d5a616683d9 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:48 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b08db82c-9dcd-43ef-aa6a-4d5a616683d9 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f79539-b708-4f1b-9c1e-797b9e5d0e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:48 devstack sudo[87976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-45b833b4-2677-4471-b823-3cf9364247f6 Feb 27 02:06:48 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:48 devstack sudo[87977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b08db82c-9dcd-43ef-aa6a-4d5a616683d9 1073741824 Feb 27 02:06:48 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3077ba59-e212-42a8-84e6-0b80463161eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:48 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Volume volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5 (eddcf77d-1ccd-4ff1-9e67-626b04020ff5): created successfully Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3077ba59-e212-42a8-84e6-0b80463161eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Flow 'volume_create_manager' (b741dd33-8c14-44b0-b827-d774adb4b21b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:48 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-5bf0ff88-171c-49ea-a620-38fcfa49daf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Created volume successfully. Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c9e59d46-babb-41c9-8638-b5e395ba264d tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:49 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b08db82c-9dcd-43ef-aa6a-4d5a616683d9 1073741824" returned: 0 in 0.647s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b08db82c-9dcd-43ef-aa6a-4d5a616683d9 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:49 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b001887-b06f-4034-ada2-8789bf582b14 tempest-CreateVolumesFromImageTest-681433369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-45b833b4-2677-4471-b823-3cf9364247f6" returned: 0 in 0.798s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b001887-b06f-4034-ada2-8789bf582b14 tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-45b833b4-2677-4471-b823-3cf9364247f6 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:49 devstack sudo[87986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b08db82c-9dcd-43ef-aa6a-4d5a616683d9 Feb 27 02:06:49 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:49 devstack sudo[87988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-45b833b4-2677-4471-b823-3cf9364247f6 Feb 27 02:06:49 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:49 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b08db82c-9dcd-43ef-aa6a-4d5a616683d9" returned: 0 in 0.444s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.087s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-949191477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f55124-ac89-44b7-94c1-c4f098e0593a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='387a3ae2ee10446fa13768105c34fd7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:45Z,use_quota=True,user_id='9527a9ffa7b845cc92b823b33e1dbdce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Creating volume 03f55124-ac89-44b7-94c1-c4f098e0593a {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:49 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-03f55124-ac89-44b7-94c1-c4f098e0593a 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77302e49-e863-4e12-b1f9-40023ba35150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b08db82c-9dcd-43ef-aa6a-4d5a616683d9', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:49 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-03f55124-ac89-44b7-94c1-c4f098e0593a 1073741824 Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0107351a-9ecb-48eb-b439-6fb3b32502fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:49 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:49 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Volume volume-b08db82c-9dcd-43ef-aa6a-4d5a616683d9 (b08db82c-9dcd-43ef-aa6a-4d5a616683d9): created successfully Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0107351a-9ecb-48eb-b439-6fb3b32502fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:49 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Flow 'volume_create_manager' (d72f0812-d9ea-407b-ae0d-93b2bfc6a73d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:49 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-294c430d-966a-4f45-92d4-19d62ba81578 tempest-VolumesGetTest-1784211569 None] Created volume successfully. Feb 27 02:06:50 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b001887-b06f-4034-ada2-8789bf582b14 tempest-CreateVolumesFromImageTest-681433369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-45b833b4-2677-4471-b823-3cf9364247f6" returned: 0 in 0.510s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4b001887-b06f-4034-ada2-8789bf582b14 tempest-CreateVolumesFromImageTest-681433369 None] Lock "cinder-quobyte-45b833b4-2677-4471-b823-3cf9364247f6" released by "delete_volume" :: held 1.341s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-4b001887-b06f-4034-ada2-8789bf582b14 tempest-CreateVolumesFromImageTest-681433369 None] Created reservations ['9889a48b-08b8-4da2-bd50-5f46b2f93a10', '6a61cb56-bb33-46b8-86ea-19b250c998ff', '28d87ef9-d0b3-43b6-92fd-0acdf60b0d5a', 'febe5ecb-8022-4b55-a7b0-a1089c8ef25a'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4b001887-b06f-4034-ada2-8789bf582b14 tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4b001887-b06f-4034-ada2-8789bf582b14 tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4b001887-b06f-4034-ada2-8789bf582b14 tempest-CreateVolumesFromImageTest-681433369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4b001887-b06f-4034-ada2-8789bf582b14 tempest-CreateVolumesFromImageTest-681433369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4b001887-b06f-4034-ada2-8789bf582b14 tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b001887-b06f-4034-ada2-8789bf582b14 tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:50 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:06:50 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:50 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-03f55124-ac89-44b7-94c1-c4f098e0593a 1073741824" returned: 0 in 0.723s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-03f55124-ac89-44b7-94c1-c4f098e0593a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:50 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b001887-b06f-4034-ada2-8789bf582b14 tempest-CreateVolumesFromImageTest-681433369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.575s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-4b001887-b06f-4034-ada2-8789bf582b14 tempest-CreateVolumesFromImageTest-681433369 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:50 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-03f55124-ac89-44b7-94c1-c4f098e0593a Feb 27 02:06:50 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:50 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-4b001887-b06f-4034-ada2-8789bf582b14 tempest-CreateVolumesFromImageTest-681433369 None] Deleted volume successfully. Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4b001887-b06f-4034-ada2-8789bf582b14 tempest-CreateVolumesFromImageTest-681433369 None] Lock "cinder-45b833b4-2677-4471-b823-3cf9364247f6-delete_volume" released by "delete_volume" :: held 2.126s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0a544bf4-d49a-456a-a3ac-c85615eb34aa tempest-VolumesGetTest-1784211569 None] Acquiring lock "cinder-b08db82c-9dcd-43ef-aa6a-4d5a616683d9-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0a544bf4-d49a-456a-a3ac-c85615eb34aa tempest-VolumesGetTest-1784211569 None] Lock "cinder-b08db82c-9dcd-43ef-aa6a-4d5a616683d9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4a5caea9-91ee-48f2-a072-3c3ba0ba1b65 tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "cinder-676731a6-6f29-4892-be37-c5021b866a30-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4a5caea9-91ee-48f2-a072-3c3ba0ba1b65 tempest-CreateVolumesFromImageTest-681433369 None] Lock "cinder-676731a6-6f29-4892-be37-c5021b866a30-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0a544bf4-d49a-456a-a3ac-c85615eb34aa tempest-VolumesGetTest-1784211569 None] Acquiring lock "cinder-quobyte-b08db82c-9dcd-43ef-aa6a-4d5a616683d9" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4a5caea9-91ee-48f2-a072-3c3ba0ba1b65 tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "cinder-quobyte-676731a6-6f29-4892-be37-c5021b866a30" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0a544bf4-d49a-456a-a3ac-c85615eb34aa tempest-VolumesGetTest-1784211569 None] Lock "cinder-quobyte-b08db82c-9dcd-43ef-aa6a-4d5a616683d9" acquired by "delete_volume" :: waited 0.017s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff29bb9-e5e1-4352-84ee-5a53aca10048]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0a544bf4-d49a-456a-a3ac-c85615eb34aa tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b08db82c-9dcd-43ef-aa6a-4d5a616683d9 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4a5caea9-91ee-48f2-a072-3c3ba0ba1b65 tempest-CreateVolumesFromImageTest-681433369 None] Lock "cinder-quobyte-676731a6-6f29-4892-be37-c5021b866a30" acquired by "delete_volume" :: waited 0.030s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fd0217-9d52-49d6-ad96-398bd9bcfaf5]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4a5caea9-91ee-48f2-a072-3c3ba0ba1b65 tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-676731a6-6f29-4892-be37-c5021b866a30 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:51 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-676731a6-6f29-4892-be37-c5021b866a30 Feb 27 02:06:51 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:51 devstack sudo[88002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b08db82c-9dcd-43ef-aa6a-4d5a616683d9 Feb 27 02:06:51 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:51 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-03f55124-ac89-44b7-94c1-c4f098e0593a" returned: 0 in 0.538s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:51 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c9e59d46-babb-41c9-8638-b5e395ba264d tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.917s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:51 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6bdda36-7cb7-4d50-b086-f8ca22262de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03f55124-ac89-44b7-94c1-c4f098e0593a', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:51 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af164965-87cc-4573-9995-60a89b8a5046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:51 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Volume volume-03f55124-ac89-44b7-94c1-c4f098e0593a (03f55124-ac89-44b7-94c1-c4f098e0593a): created successfully Feb 27 02:06:51 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af164965-87cc-4573-9995-60a89b8a5046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:51 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Flow 'volume_create_manager' (cec2b152-09ce-4c6c-8738-4949364e968e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:51 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-c9e59d46-babb-41c9-8638-b5e395ba264d tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Creating offline snapshot 06497ca0-78c1-405f-9173-71010ca382ac of volume eddcf77d-1ccd-4ff1-9e67-626b04020ff5 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:06:51 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-6653e294-2abf-4885-b6bf-b14f8955d32e tempest-VolumesListAdminTestJSON-2092363752 None] Created volume successfully. Feb 27 02:06:51 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c462f7ba-5f98-4488-a620-43aa75ff85a2]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c9e59d46-babb-41c9-8638-b5e395ba264d tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:51 devstack sudo[88007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5 Feb 27 02:06:51 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:51 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4a5caea9-91ee-48f2-a072-3c3ba0ba1b65 tempest-CreateVolumesFromImageTest-681433369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-676731a6-6f29-4892-be37-c5021b866a30" returned: 0 in 0.561s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4a5caea9-91ee-48f2-a072-3c3ba0ba1b65 tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-676731a6-6f29-4892-be37-c5021b866a30 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:51 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0a544bf4-d49a-456a-a3ac-c85615eb34aa tempest-VolumesGetTest-1784211569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b08db82c-9dcd-43ef-aa6a-4d5a616683d9" returned: 0 in 0.607s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0a544bf4-d49a-456a-a3ac-c85615eb34aa tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b08db82c-9dcd-43ef-aa6a-4d5a616683d9 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:51 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-676731a6-6f29-4892-be37-c5021b866a30 Feb 27 02:06:51 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:51 devstack sudo[88017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b08db82c-9dcd-43ef-aa6a-4d5a616683d9 Feb 27 02:06:51 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:51 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c9e59d46-babb-41c9-8638-b5e395ba264d tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5" returned: 0 in 0.592s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c9e59d46-babb-41c9-8638-b5e395ba264d tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.06497ca0-78c1-405f-9173-71010ca382ac 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:51 devstack sudo[88022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.06497ca0-78c1-405f-9173-71010ca382ac 1G Feb 27 02:06:51 devstack sudo[88022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:52 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4a5caea9-91ee-48f2-a072-3c3ba0ba1b65 tempest-CreateVolumesFromImageTest-681433369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-676731a6-6f29-4892-be37-c5021b866a30" returned: 0 in 0.487s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4a5caea9-91ee-48f2-a072-3c3ba0ba1b65 tempest-CreateVolumesFromImageTest-681433369 None] Lock "cinder-quobyte-676731a6-6f29-4892-be37-c5021b866a30" released by "delete_volume" :: held 1.084s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:52 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0a544bf4-d49a-456a-a3ac-c85615eb34aa tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b08db82c-9dcd-43ef-aa6a-4d5a616683d9" returned: 0 in 0.503s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0a544bf4-d49a-456a-a3ac-c85615eb34aa tempest-VolumesGetTest-1784211569 None] Lock "cinder-quobyte-b08db82c-9dcd-43ef-aa6a-4d5a616683d9" released by "delete_volume" :: held 1.144s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-4a5caea9-91ee-48f2-a072-3c3ba0ba1b65 tempest-CreateVolumesFromImageTest-681433369 None] Created reservations ['b01ff508-ca06-41a0-bc9c-9e0d4f600f3e', '8e556233-7c93-4ed4-9492-05b2c208818d', 'bd80f2c3-6ec5-4228-8c9d-0144310b2bf4', '63bed359-a5f6-401a-9ab5-3cee5d302884'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-0a544bf4-d49a-456a-a3ac-c85615eb34aa tempest-VolumesGetTest-1784211569 None] Created reservations ['30255247-0ac9-40e4-85de-cdaafffedb7d', 'f0732615-f1c2-4607-862a-c02a7a226b1f', '99ff9b11-298e-4ebe-b5b6-7afeecdfe95f', 'd70261d3-5bf2-46fe-b1be-1896da29c238'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4a5caea9-91ee-48f2-a072-3c3ba0ba1b65 tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4a5caea9-91ee-48f2-a072-3c3ba0ba1b65 tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4a5caea9-91ee-48f2-a072-3c3ba0ba1b65 tempest-CreateVolumesFromImageTest-681433369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4a5caea9-91ee-48f2-a072-3c3ba0ba1b65 tempest-CreateVolumesFromImageTest-681433369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4a5caea9-91ee-48f2-a072-3c3ba0ba1b65 tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4a5caea9-91ee-48f2-a072-3c3ba0ba1b65 tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:52 devstack sudo[88026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:06:52 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0a544bf4-d49a-456a-a3ac-c85615eb34aa tempest-VolumesGetTest-1784211569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0a544bf4-d49a-456a-a3ac-c85615eb34aa tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0a544bf4-d49a-456a-a3ac-c85615eb34aa tempest-VolumesGetTest-1784211569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0a544bf4-d49a-456a-a3ac-c85615eb34aa tempest-VolumesGetTest-1784211569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0a544bf4-d49a-456a-a3ac-c85615eb34aa tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0a544bf4-d49a-456a-a3ac-c85615eb34aa tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:52 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:06:52 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:52 devstack sudo[88022]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c9e59d46-babb-41c9-8638-b5e395ba264d tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.06497ca0-78c1-405f-9173-71010ca382ac 1G" returned: 0 in 0.656s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c9e59d46-babb-41c9-8638-b5e395ba264d tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.06497ca0-78c1-405f-9173-71010ca382ac {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:52 devstack sudo[88033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.06497ca0-78c1-405f-9173-71010ca382ac Feb 27 02:06:52 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Flow 'volume_create_manager' (9688e13d-de3b-437a-9b7d-1b6e1503a08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a608a0-0011-483a-8b09-9ac686eb271f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a608a0-0011-483a-8b09-9ac686eb271f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-209416905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24dfe335-be1c-48fe-bd50-349006911453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='387a3ae2ee10446fa13768105c34fd7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:53Z,use_quota=True,user_id='9527a9ffa7b845cc92b823b33e1dbdce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182e63cc-73b3-4a70-83ad-6769b09358a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182e63cc-73b3-4a70-83ad-6769b09358a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a92bfcd9-412a-44c9-bab0-75af1697e10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a92bfcd9-412a-44c9-bab0-75af1697e10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24dfe335-be1c-48fe-bd50-349006911453', 'volume_name': 'volume-24dfe335-be1c-48fe-bd50-349006911453', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef53cb2f-c95c-4a3f-bba5-955b51dcf535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef53cb2f-c95c-4a3f-bba5-955b51dcf535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413f6452-6e43-41eb-9957-a45f0f1dee90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:52 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Volume 24dfe335-be1c-48fe-bd50-349006911453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24dfe335-be1c-48fe-bd50-349006911453', 'volume_size': 1} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:52 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4a5caea9-91ee-48f2-a072-3c3ba0ba1b65 tempest-CreateVolumesFromImageTest-681433369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.552s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-4a5caea9-91ee-48f2-a072-3c3ba0ba1b65 tempest-CreateVolumesFromImageTest-681433369 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:52 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-4a5caea9-91ee-48f2-a072-3c3ba0ba1b65 tempest-CreateVolumesFromImageTest-681433369 None] Deleted volume successfully. Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4a5caea9-91ee-48f2-a072-3c3ba0ba1b65 tempest-CreateVolumesFromImageTest-681433369 None] Lock "cinder-676731a6-6f29-4892-be37-c5021b866a30-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:52 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0a544bf4-d49a-456a-a3ac-c85615eb34aa tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.540s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-0a544bf4-d49a-456a-a3ac-c85615eb34aa tempest-VolumesGetTest-1784211569 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:52 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-0a544bf4-d49a-456a-a3ac-c85615eb34aa tempest-VolumesGetTest-1784211569 None] Deleted volume successfully. Feb 27 02:06:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0a544bf4-d49a-456a-a3ac-c85615eb34aa tempest-VolumesGetTest-1784211569 None] Lock "cinder-b08db82c-9dcd-43ef-aa6a-4d5a616683d9-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-56306e34-66d8-40d1-b45a-4f0a7ecce66d tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "cinder-ada90d79-96c4-4e94-b85f-df3952621b58-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-56306e34-66d8-40d1-b45a-4f0a7ecce66d tempest-CreateVolumesFromImageTest-681433369 None] Lock "cinder-ada90d79-96c4-4e94-b85f-df3952621b58-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:53 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c9e59d46-babb-41c9-8638-b5e395ba264d tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.06497ca0-78c1-405f-9173-71010ca382ac" returned: 0 in 0.531s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:53 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-c9e59d46-babb-41c9-8638-b5e395ba264d tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.06497ca0-78c1-405f-9173-71010ca382ac is being set with open permissions: ugo+rw Feb 27 02:06:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c9e59d46-babb-41c9-8638-b5e395ba264d tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.06497ca0-78c1-405f-9173-71010ca382ac {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:53 devstack sudo[88040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.06497ca0-78c1-405f-9173-71010ca382ac Feb 27 02:06:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d102b848-4778-426f-a93a-62a9829f610e tempest-VolumesGetTest-1784211569 None] Acquiring lock "cinder-28482016-ca49-440c-b7b1-6422dafa5b0d-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:53 devstack sudo[88040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d102b848-4778-426f-a93a-62a9829f610e tempest-VolumesGetTest-1784211569 None] Lock "cinder-28482016-ca49-440c-b7b1-6422dafa5b0d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-56306e34-66d8-40d1-b45a-4f0a7ecce66d tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "cinder-quobyte-ada90d79-96c4-4e94-b85f-df3952621b58" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-56306e34-66d8-40d1-b45a-4f0a7ecce66d tempest-CreateVolumesFromImageTest-681433369 None] Lock "cinder-quobyte-ada90d79-96c4-4e94-b85f-df3952621b58" acquired by "delete_volume" :: waited 0.016s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:53 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c8ed53-13c7-4528-b685-a55226b87854]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d102b848-4778-426f-a93a-62a9829f610e tempest-VolumesGetTest-1784211569 None] Acquiring lock "cinder-quobyte-28482016-ca49-440c-b7b1-6422dafa5b0d" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-56306e34-66d8-40d1-b45a-4f0a7ecce66d tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ada90d79-96c4-4e94-b85f-df3952621b58 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d102b848-4778-426f-a93a-62a9829f610e tempest-VolumesGetTest-1784211569 None] Lock "cinder-quobyte-28482016-ca49-440c-b7b1-6422dafa5b0d" acquired by "delete_volume" :: waited 0.019s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:53 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1b20e5-9b7a-487e-b987-82e724978d68]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d102b848-4778-426f-a93a-62a9829f610e tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-28482016-ca49-440c-b7b1-6422dafa5b0d {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:53 devstack sudo[88042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ada90d79-96c4-4e94-b85f-df3952621b58 Feb 27 02:06:53 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:53 devstack sudo[88043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-28482016-ca49-440c-b7b1-6422dafa5b0d Feb 27 02:06:53 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:53 devstack sudo[88040]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c9e59d46-babb-41c9-8638-b5e395ba264d tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.06497ca0-78c1-405f-9173-71010ca382ac" returned: 0 in 0.535s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c9e59d46-babb-41c9-8638-b5e395ba264d tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:53 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.info Feb 27 02:06:53 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:53 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-56306e34-66d8-40d1-b45a-4f0a7ecce66d tempest-CreateVolumesFromImageTest-681433369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ada90d79-96c4-4e94-b85f-df3952621b58" returned: 0 in 0.570s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-56306e34-66d8-40d1-b45a-4f0a7ecce66d tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ada90d79-96c4-4e94-b85f-df3952621b58 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:53 devstack sudo[88055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ada90d79-96c4-4e94-b85f-df3952621b58 Feb 27 02:06:53 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:53 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d102b848-4778-426f-a93a-62a9829f610e tempest-VolumesGetTest-1784211569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-28482016-ca49-440c-b7b1-6422dafa5b0d" returned: 0 in 0.579s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d102b848-4778-426f-a93a-62a9829f610e tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-28482016-ca49-440c-b7b1-6422dafa5b0d {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:53 devstack sudo[88057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-28482016-ca49-440c-b7b1-6422dafa5b0d Feb 27 02:06:53 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:54 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c9e59d46-babb-41c9-8638-b5e395ba264d tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.info" returned: 0 in 0.517s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:54 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-c9e59d46-babb-41c9-8638-b5e395ba264d tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.info is being set with open permissions: ugo+rw Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c9e59d46-babb-41c9-8638-b5e395ba264d tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:54 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.info Feb 27 02:06:54 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:54 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-56306e34-66d8-40d1-b45a-4f0a7ecce66d tempest-CreateVolumesFromImageTest-681433369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ada90d79-96c4-4e94-b85f-df3952621b58" returned: 0 in 0.505s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-56306e34-66d8-40d1-b45a-4f0a7ecce66d tempest-CreateVolumesFromImageTest-681433369 None] Lock "cinder-quobyte-ada90d79-96c4-4e94-b85f-df3952621b58" released by "delete_volume" :: held 1.112s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:54 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d102b848-4778-426f-a93a-62a9829f610e tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-28482016-ca49-440c-b7b1-6422dafa5b0d" returned: 0 in 0.544s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d102b848-4778-426f-a93a-62a9829f610e tempest-VolumesGetTest-1784211569 None] Lock "cinder-quobyte-28482016-ca49-440c-b7b1-6422dafa5b0d" released by "delete_volume" :: held 1.153s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-56306e34-66d8-40d1-b45a-4f0a7ecce66d tempest-CreateVolumesFromImageTest-681433369 None] Created reservations ['0cc9cc68-d966-4c4a-ba93-8acfa854e629', '237eafd9-14e9-4efd-95ce-ef1bafed8a7b', '02394939-e085-450a-b980-3238be027d6d', '122cfe78-3d8b-4840-b697-70ba78df31b9'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-d102b848-4778-426f-a93a-62a9829f610e tempest-VolumesGetTest-1784211569 None] Created reservations ['b162691f-1fa6-468b-b1c9-9f6b3d736120', '1a9cacd7-083d-4274-9e0e-77eb12afa623', '97a11f61-8136-476a-a65b-df2f8fc3e751', '4e4975b4-15f5-40b3-a730-08e3ce485d95'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-56306e34-66d8-40d1-b45a-4f0a7ecce66d tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-56306e34-66d8-40d1-b45a-4f0a7ecce66d tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-56306e34-66d8-40d1-b45a-4f0a7ecce66d tempest-CreateVolumesFromImageTest-681433369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-56306e34-66d8-40d1-b45a-4f0a7ecce66d tempest-CreateVolumesFromImageTest-681433369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-56306e34-66d8-40d1-b45a-4f0a7ecce66d tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-56306e34-66d8-40d1-b45a-4f0a7ecce66d tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:54 devstack sudo[88064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:06:54 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d102b848-4778-426f-a93a-62a9829f610e tempest-VolumesGetTest-1784211569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d102b848-4778-426f-a93a-62a9829f610e tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d102b848-4778-426f-a93a-62a9829f610e tempest-VolumesGetTest-1784211569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d102b848-4778-426f-a93a-62a9829f610e tempest-VolumesGetTest-1784211569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d102b848-4778-426f-a93a-62a9829f610e tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d102b848-4778-426f-a93a-62a9829f610e tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:54 devstack sudo[88066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:06:54 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:54 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c9e59d46-babb-41c9-8638-b5e395ba264d tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.info" returned: 0 in 0.592s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c9e59d46-babb-41c9-8638-b5e395ba264d tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.525s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.088s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-209416905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24dfe335-be1c-48fe-bd50-349006911453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='387a3ae2ee10446fa13768105c34fd7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:53Z,use_quota=True,user_id='9527a9ffa7b845cc92b823b33e1dbdce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Creating volume 24dfe335-be1c-48fe-bd50-349006911453 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:54 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-24dfe335-be1c-48fe-bd50-349006911453 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:54 devstack sudo[88069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-24dfe335-be1c-48fe-bd50-349006911453 1073741824 Feb 27 02:06:54 devstack sudo[88069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:54 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-c9e59d46-babb-41c9-8638-b5e395ba264d tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Create snapshot completed successfully Feb 27 02:06:54 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-56306e34-66d8-40d1-b45a-4f0a7ecce66d tempest-CreateVolumesFromImageTest-681433369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.473s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-56306e34-66d8-40d1-b45a-4f0a7ecce66d tempest-CreateVolumesFromImageTest-681433369 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:54 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-56306e34-66d8-40d1-b45a-4f0a7ecce66d tempest-CreateVolumesFromImageTest-681433369 None] Deleted volume successfully. Feb 27 02:06:54 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-56306e34-66d8-40d1-b45a-4f0a7ecce66d tempest-CreateVolumesFromImageTest-681433369 None] Lock "cinder-ada90d79-96c4-4e94-b85f-df3952621b58-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:55 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d102b848-4778-426f-a93a-62a9829f610e tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.488s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-d102b848-4778-426f-a93a-62a9829f610e tempest-VolumesGetTest-1784211569 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:55 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-d102b848-4778-426f-a93a-62a9829f610e tempest-VolumesGetTest-1784211569 None] Deleted volume successfully. Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d102b848-4778-426f-a93a-62a9829f610e tempest-VolumesGetTest-1784211569 None] Lock "cinder-28482016-ca49-440c-b7b1-6422dafa5b0d-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bcffa81f-b619-4935-8bcc-e794e715e1b1 tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "cinder-7b8287b0-de4c-49ec-8fd9-a28a752253c4-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:55 devstack sudo[88069]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-24dfe335-be1c-48fe-bd50-349006911453 1073741824" returned: 0 in 0.545s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bcffa81f-b619-4935-8bcc-e794e715e1b1 tempest-CreateVolumesFromImageTest-681433369 None] Lock "cinder-7b8287b0-de4c-49ec-8fd9-a28a752253c4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bcffa81f-b619-4935-8bcc-e794e715e1b1 tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "cinder-quobyte-7b8287b0-de4c-49ec-8fd9-a28a752253c4" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-24dfe335-be1c-48fe-bd50-349006911453 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bcffa81f-b619-4935-8bcc-e794e715e1b1 tempest-CreateVolumesFromImageTest-681433369 None] Lock "cinder-quobyte-7b8287b0-de4c-49ec-8fd9-a28a752253c4" acquired by "delete_volume" :: waited 0.026s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:55 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-24dfe335-be1c-48fe-bd50-349006911453 Feb 27 02:06:55 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9a1336db-4e9b-49c6-954f-eb532cce5d53 tempest-VolumesGetTest-1784211569 None] Acquiring lock "cinder-0cc00684-a3e8-41ea-b262-d508dba6523b-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ed4115-46f6-4088-92cf-3364ab921982]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcffa81f-b619-4935-8bcc-e794e715e1b1 tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7b8287b0-de4c-49ec-8fd9-a28a752253c4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9a1336db-4e9b-49c6-954f-eb532cce5d53 tempest-VolumesGetTest-1784211569 None] Lock "cinder-0cc00684-a3e8-41ea-b262-d508dba6523b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9a1336db-4e9b-49c6-954f-eb532cce5d53 tempest-VolumesGetTest-1784211569 None] Acquiring lock "cinder-quobyte-0cc00684-a3e8-41ea-b262-d508dba6523b" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9a1336db-4e9b-49c6-954f-eb532cce5d53 tempest-VolumesGetTest-1784211569 None] Lock "cinder-quobyte-0cc00684-a3e8-41ea-b262-d508dba6523b" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d942c1-b919-4e43-a968-611e8faa0135]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9a1336db-4e9b-49c6-954f-eb532cce5d53 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:55 devstack sudo[88078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7b8287b0-de4c-49ec-8fd9-a28a752253c4 Feb 27 02:06:55 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:55 devstack sudo[88079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b Feb 27 02:06:55 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:55 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-24dfe335-be1c-48fe-bd50-349006911453" returned: 0 in 0.482s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413f6452-6e43-41eb-9957-a45f0f1dee90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24dfe335-be1c-48fe-bd50-349006911453', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c690390c-fb82-42c1-be38-400db76a7642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:55 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Volume volume-24dfe335-be1c-48fe-bd50-349006911453 (24dfe335-be1c-48fe-bd50-349006911453): created successfully Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c690390c-fb82-42c1-be38-400db76a7642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Flow 'volume_create_manager' (9688e13d-de3b-437a-9b7d-1b6e1503a08c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:55 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-25eb88ef-a460-4094-8725-83a94066b82e tempest-VolumesListAdminTestJSON-2092363752 None] Created volume successfully. Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Acquiring lock "cinder-06497ca0-78c1-405f-9173-71010ca382ac-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Lock "cinder-06497ca0-78c1-405f-9173-71010ca382ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Acquiring lock "cinder-quobyte-eddcf77d-1ccd-4ff1-9e67-626b04020ff5" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Lock "cinder-quobyte-eddcf77d-1ccd-4ff1-9e67-626b04020ff5" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Acquiring lock "cinder-quobyte-06497ca0-78c1-405f-9173-71010ca382ac" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Lock "cinder-quobyte-06497ca0-78c1-405f-9173-71010ca382ac" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Deleting offline snapshot 06497ca0-78c1-405f-9173-71010ca382ac of volume eddcf77d-1ccd-4ff1-9e67-626b04020ff5 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] snapshot_file for this snap is: volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.06497ca0-78c1-405f-9173-71010ca382ac {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:06:56 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcffa81f-b619-4935-8bcc-e794e715e1b1 tempest-CreateVolumesFromImageTest-681433369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7b8287b0-de4c-49ec-8fd9-a28a752253c4" returned: 0 in 0.625s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcffa81f-b619-4935-8bcc-e794e715e1b1 tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7b8287b0-de4c-49ec-8fd9-a28a752253c4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bdd77b-733d-4436-a9c3-67afecd71fd0]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.06497ca0-78c1-405f-9173-71010ca382ac {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:56 devstack sudo[88087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7b8287b0-de4c-49ec-8fd9-a28a752253c4 Feb 27 02:06:56 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:56 devstack sudo[88089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.06497ca0-78c1-405f-9173-71010ca382ac Feb 27 02:06:56 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:56 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9a1336db-4e9b-49c6-954f-eb532cce5d53 tempest-VolumesGetTest-1784211569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b" returned: 0 in 0.644s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9a1336db-4e9b-49c6-954f-eb532cce5d53 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:56 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b Feb 27 02:06:56 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:56 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcffa81f-b619-4935-8bcc-e794e715e1b1 tempest-CreateVolumesFromImageTest-681433369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7b8287b0-de4c-49ec-8fd9-a28a752253c4" returned: 0 in 0.510s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bcffa81f-b619-4935-8bcc-e794e715e1b1 tempest-CreateVolumesFromImageTest-681433369 None] Lock "cinder-quobyte-7b8287b0-de4c-49ec-8fd9-a28a752253c4" released by "delete_volume" :: held 1.167s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-bcffa81f-b619-4935-8bcc-e794e715e1b1 tempest-CreateVolumesFromImageTest-681433369 None] Created reservations ['695db85e-4308-4537-a073-91c78d6a466a', '86872251-9d1a-4620-85aa-1a73b635c1d9', '169bb504-65a8-4fbd-8762-6dcb77ea4ee5', '15b41a42-3910-42e0-9a9b-dc3a7359bcb4'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:56 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9a1336db-4e9b-49c6-954f-eb532cce5d53 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0cc00684-a3e8-41ea-b262-d508dba6523b" returned: 0 in 0.489s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:56 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9a1336db-4e9b-49c6-954f-eb532cce5d53 tempest-VolumesGetTest-1784211569 None] Lock "cinder-quobyte-0cc00684-a3e8-41ea-b262-d508dba6523b" released by "delete_volume" :: held 1.171s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.06497ca0-78c1-405f-9173-71010ca382ac" returned: 0 in 0.617s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6118ef01-f6a0-41f5-8f5a-afecaacf262c]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bcffa81f-b619-4935-8bcc-e794e715e1b1 tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bcffa81f-b619-4935-8bcc-e794e715e1b1 tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-bcffa81f-b619-4935-8bcc-e794e715e1b1 tempest-CreateVolumesFromImageTest-681433369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-bcffa81f-b619-4935-8bcc-e794e715e1b1 tempest-CreateVolumesFromImageTest-681433369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bcffa81f-b619-4935-8bcc-e794e715e1b1 tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcffa81f-b619-4935-8bcc-e794e715e1b1 tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-9a1336db-4e9b-49c6-954f-eb532cce5d53 tempest-VolumesGetTest-1784211569 None] Created reservations ['eea8bce1-64b7-446b-8fd8-c3a53e8adac2', '9ceca4fd-4fab-45ee-8d3f-ec807d52ffcb', 'c55d0405-4a71-46e6-9a03-aff0b8fcea6f', 'f2574921-caa9-4815-877a-5ba2bfcad433'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:56 devstack sudo[88101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:06:56 devstack sudo[88101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:56 devstack sudo[88100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5 Feb 27 02:06:56 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9a1336db-4e9b-49c6-954f-eb532cce5d53 tempest-VolumesGetTest-1784211569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9a1336db-4e9b-49c6-954f-eb532cce5d53 tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-9a1336db-4e9b-49c6-954f-eb532cce5d53 tempest-VolumesGetTest-1784211569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-9a1336db-4e9b-49c6-954f-eb532cce5d53 tempest-VolumesGetTest-1784211569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9a1336db-4e9b-49c6-954f-eb532cce5d53 tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9a1336db-4e9b-49c6-954f-eb532cce5d53 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:56 devstack sudo[88104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:06:56 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Flow 'volume_create_manager' (37d7099c-aabe-4e34-80cb-7f6bd90a49ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec57e51-337c-442e-b6de-e1897acae446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec57e51-337c-442e-b6de-e1897acae446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1062688138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cbda092-b9bb-4b87-9aff-4ef6b4dba534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='387a3ae2ee10446fa13768105c34fd7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:57Z,use_quota=True,user_id='9527a9ffa7b845cc92b823b33e1dbdce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d157ce0-7d96-44fb-9b99-ebabdd775904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d157ce0-7d96-44fb-9b99-ebabdd775904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9206af20-1628-4328-a539-69dd998afaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9206af20-1628-4328-a539-69dd998afaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cbda092-b9bb-4b87-9aff-4ef6b4dba534', 'volume_name': 'volume-5cbda092-b9bb-4b87-9aff-4ef6b4dba534', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc62e6fe-eb84-4125-adac-1ff4a5223d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc62e6fe-eb84-4125-adac-1ff4a5223d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59fa740e-b15f-4114-a304-f6b73aeb4341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:57 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Volume 5cbda092-b9bb-4b87-9aff-4ef6b4dba534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cbda092-b9bb-4b87-9aff-4ef6b4dba534', 'volume_size': 1} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1062688138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cbda092-b9bb-4b87-9aff-4ef6b4dba534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='387a3ae2ee10446fa13768105c34fd7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:57Z,use_quota=True,user_id='9527a9ffa7b845cc92b823b33e1dbdce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Creating volume 5cbda092-b9bb-4b87-9aff-4ef6b4dba534 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:57 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5cbda092-b9bb-4b87-9aff-4ef6b4dba534 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:57 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5cbda092-b9bb-4b87-9aff-4ef6b4dba534 1073741824 Feb 27 02:06:57 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:57 devstack sudo[88101]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcffa81f-b619-4935-8bcc-e794e715e1b1 tempest-CreateVolumesFromImageTest-681433369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.586s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-bcffa81f-b619-4935-8bcc-e794e715e1b1 tempest-CreateVolumesFromImageTest-681433369 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:57 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-bcffa81f-b619-4935-8bcc-e794e715e1b1 tempest-CreateVolumesFromImageTest-681433369 None] Deleted volume successfully. Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bcffa81f-b619-4935-8bcc-e794e715e1b1 tempest-CreateVolumesFromImageTest-681433369 None] Lock "cinder-7b8287b0-de4c-49ec-8fd9-a28a752253c4-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:57 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5" returned: 0 in 0.757s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.06497ca0-78c1-405f-9173-71010ca382ac {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:57 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.06497ca0-78c1-405f-9173-71010ca382ac Feb 27 02:06:57 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:57 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9a1336db-4e9b-49c6-954f-eb532cce5d53 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.663s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-9a1336db-4e9b-49c6-954f-eb532cce5d53 tempest-VolumesGetTest-1784211569 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:57 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-9a1336db-4e9b-49c6-954f-eb532cce5d53 tempest-VolumesGetTest-1784211569 None] Deleted volume successfully. Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-46309d05-7822-458d-b8c1-4dc7668d2128 tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "cinder-3e8bef1f-c17c-459c-be72-21eb1d4211ca-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9a1336db-4e9b-49c6-954f-eb532cce5d53 tempest-VolumesGetTest-1784211569 None] Lock "cinder-0cc00684-a3e8-41ea-b262-d508dba6523b-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-46309d05-7822-458d-b8c1-4dc7668d2128 tempest-CreateVolumesFromImageTest-681433369 None] Lock "cinder-3e8bef1f-c17c-459c-be72-21eb1d4211ca-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-46309d05-7822-458d-b8c1-4dc7668d2128 tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "cinder-quobyte-3e8bef1f-c17c-459c-be72-21eb1d4211ca" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-46309d05-7822-458d-b8c1-4dc7668d2128 tempest-CreateVolumesFromImageTest-681433369 None] Lock "cinder-quobyte-3e8bef1f-c17c-459c-be72-21eb1d4211ca" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c83fef-bf7b-4bf4-adbd-3b92179911a9]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-46309d05-7822-458d-b8c1-4dc7668d2128 tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e8bef1f-c17c-459c-be72-21eb1d4211ca {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:57 devstack sudo[88115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e8bef1f-c17c-459c-be72-21eb1d4211ca Feb 27 02:06:57 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:57 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5cbda092-b9bb-4b87-9aff-4ef6b4dba534 1073741824" returned: 0 in 0.653s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5cbda092-b9bb-4b87-9aff-4ef6b4dba534 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:58 devstack sudo[88123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5cbda092-b9bb-4b87-9aff-4ef6b4dba534 Feb 27 02:06:58 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:58 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.06497ca0-78c1-405f-9173-71010ca382ac" returned: 0 in 0.688s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.06497ca0-78c1-405f-9173-71010ca382ac {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:58 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.06497ca0-78c1-405f-9173-71010ca382ac Feb 27 02:06:58 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:58 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-46309d05-7822-458d-b8c1-4dc7668d2128 tempest-CreateVolumesFromImageTest-681433369 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e8bef1f-c17c-459c-be72-21eb1d4211ca" returned: 0 in 0.569s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-46309d05-7822-458d-b8c1-4dc7668d2128 tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e8bef1f-c17c-459c-be72-21eb1d4211ca {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:58 devstack sudo[88131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e8bef1f-c17c-459c-be72-21eb1d4211ca Feb 27 02:06:58 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Flow 'volume_create_manager' (7d138296-58e1-434b-a24c-db4d419d0096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0619f6-7e80-4d51-a5c4-166edc6d8558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0619f6-7e80-4d51-a5c4-166edc6d8558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1752190720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=698596b6-717c-484d-bf55-65862d7e9ed3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e07111062ffc436da7aa27ae6d219d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:58Z,use_quota=True,user_id='ee4a42c7c9a24aad92ddd645d91b635d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5386d236-49a9-489a-b875-151898f6902c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5386d236-49a9-489a-b875-151898f6902c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be7cf7f0-d32c-4232-9a57-7624b7d312b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.image.glance [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Creating Keystone auth plugin from conf {{(pid=82683) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 02:06:58 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5cbda092-b9bb-4b87-9aff-4ef6b4dba534" returned: 0 in 0.529s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59fa740e-b15f-4114-a304-f6b73aeb4341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cbda092-b9bb-4b87-9aff-4ef6b4dba534', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4d3bc6-7dbd-4e40-907f-870c942a94b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:58 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Volume volume-5cbda092-b9bb-4b87-9aff-4ef6b4dba534 (5cbda092-b9bb-4b87-9aff-4ef6b4dba534): created successfully Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4d3bc6-7dbd-4e40-907f-870c942a94b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Flow 'volume_create_manager' (37d7099c-aabe-4e34-80cb-7f6bd90a49ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:58 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-0a619ec1-642d-488e-9a05-9c2990d33f4d tempest-VolumesListAdminTestJSON-2092363752 None] Created volume successfully. Feb 27 02:06:58 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5.06497ca0-78c1-405f-9173-71010ca382ac" returned: 0 in 0.540s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Lock "cinder-quobyte-06497ca0-78c1-405f-9173-71010ca382ac" released by "_delete_snapshot" :: held 2.686s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Lock "cinder-quobyte-eddcf77d-1ccd-4ff1-9e67-626b04020ff5" released by "delete_snapshot" :: held 2.711s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:58 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-46309d05-7822-458d-b8c1-4dc7668d2128 tempest-CreateVolumesFromImageTest-681433369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e8bef1f-c17c-459c-be72-21eb1d4211ca" returned: 0 in 0.552s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be7cf7f0-d32c-4232-9a57-7624b7d312b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '698596b6-717c-484d-bf55-65862d7e9ed3', 'volume_name': 'volume-698596b6-717c-484d-bf55-65862d7e9ed3', 'volume_size': 1, 'image_id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '757f43b353254b8d946a078a47db0c70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1936e0bd-39f5-48aa-82e1-d79c80c86062/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3015452e-14f2-4874-a24f-96295798501a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3015452e-14f2-4874-a24f-96295798501a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01363215-51f7-44d1-a3ac-f84656a2b5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:58 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Volume 698596b6-717c-484d-bf55-65862d7e9ed3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-698596b6-717c-484d-bf55-65862d7e9ed3', 'volume_size': 1, 'image_id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '757f43b353254b8d946a078a47db0c70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1936e0bd-39f5-48aa-82e1-d79c80c86062/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Trying to clone 698596b6-717c-484d-bf55-65862d7e9ed3 from image 1936e0bd-39f5-48aa-82e1-d79c80c86062 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}]). {{(pid=82683) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-46309d05-7822-458d-b8c1-4dc7668d2128 tempest-CreateVolumesFromImageTest-681433369 None] Lock "cinder-quobyte-3e8bef1f-c17c-459c-be72-21eb1d4211ca" released by "delete_volume" :: held 1.170s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Created reservations ['3d8965ee-e9f7-45b6-83cf-c352e4183213', 'd2d0399e-3987-4dde-9773-9f407373d620', '43ec78a8-39ea-4a7b-8ad1-93cbc0643bc8', '812eb183-48be-4405-86cc-d4640ff9a6ca'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-46309d05-7822-458d-b8c1-4dc7668d2128 tempest-CreateVolumesFromImageTest-681433369 None] Created reservations ['5590f858-783e-46c2-98c7-3b8ff5411e96', 'f5bb3276-4e01-4227-aa81-46871750c6ac', '4ad54181-6a9e-4772-98e0-2c0811f6582f', '00be29b2-52ac-457a-93ac-2db5d7f5bef3'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:06:58 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Delete snapshot completed successfully. Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-73921f2c-6cd6-4db9-9d8b-6ed2f2f5b22b tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Lock "cinder-06497ca0-78c1-405f-9173-71010ca382ac-delete_snapshot" released by "delete_snapshot" :: held 2.964s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:58 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_g5lcfuzvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82683) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 02:06:58 devstack cinder-volume[82683]: INFO cinder.image.image_utils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Image download 20.69 MB at 20.69 MB/s Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-46309d05-7822-458d-b8c1-4dc7668d2128 tempest-CreateVolumesFromImageTest-681433369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-46309d05-7822-458d-b8c1-4dc7668d2128 tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-46309d05-7822-458d-b8c1-4dc7668d2128 tempest-CreateVolumesFromImageTest-681433369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-46309d05-7822-458d-b8c1-4dc7668d2128 tempest-CreateVolumesFromImageTest-681433369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-46309d05-7822-458d-b8c1-4dc7668d2128 tempest-CreateVolumesFromImageTest-681433369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-46309d05-7822-458d-b8c1-4dc7668d2128 tempest-CreateVolumesFromImageTest-681433369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20b9a92-9563-40fb-ad23-3e525c1f649c]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_g5lcfuzvdevstack@QuobyteHD {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:59 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:06:59 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:59 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_g5lcfuzvdevstack@QuobyteHD Feb 27 02:06:59 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-fae6687c-5e9b-408d-b1df-e9eb955d1fa1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Acquiring lock "cinder-eddcf77d-1ccd-4ff1-9e67-626b04020ff5-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-fae6687c-5e9b-408d-b1df-e9eb955d1fa1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Lock "cinder-eddcf77d-1ccd-4ff1-9e67-626b04020ff5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-fae6687c-5e9b-408d-b1df-e9eb955d1fa1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Acquiring lock "cinder-quobyte-eddcf77d-1ccd-4ff1-9e67-626b04020ff5" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-fae6687c-5e9b-408d-b1df-e9eb955d1fa1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Lock "cinder-quobyte-eddcf77d-1ccd-4ff1-9e67-626b04020ff5" acquired by "delete_volume" :: waited 0.024s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5781af94-013f-43d8-8d7e-1bf73a857a85]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fae6687c-5e9b-408d-b1df-e9eb955d1fa1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:59 devstack sudo[88141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5 Feb 27 02:06:59 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:59 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-46309d05-7822-458d-b8c1-4dc7668d2128 tempest-CreateVolumesFromImageTest-681433369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.510s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-46309d05-7822-458d-b8c1-4dc7668d2128 tempest-CreateVolumesFromImageTest-681433369 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:06:59 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-46309d05-7822-458d-b8c1-4dc7668d2128 tempest-CreateVolumesFromImageTest-681433369 None] Deleted volume successfully. Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-46309d05-7822-458d-b8c1-4dc7668d2128 tempest-CreateVolumesFromImageTest-681433369 None] Lock "cinder-3e8bef1f-c17c-459c-be72-21eb1d4211ca-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:06:59 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_g5lcfuzvdevstack@QuobyteHD" returned: 0 in 0.642s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Temporary image 1936e0bd-39f5-48aa-82e1-d79c80c86062 is fetched for user ee4a42c7c9a24aad92ddd645d91b635d. {{(pid=82683) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f555fb-5dc7-4784-b6ef-a191a3a80362]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_g5lcfuzvdevstack@QuobyteHD {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:06:59 devstack sudo[88147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_g5lcfuzvdevstack@QuobyteHD Feb 27 02:06:59 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Flow 'volume_create_manager' (c889d17e-e289-422a-97bd-ec05c050610a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee182e69-3b7d-4731-bd02-d7634f33cbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:59 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee182e69-3b7d-4731-bd02-d7634f33cbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34bf230b-6083-4d26-80fb-9251d9e8178f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a3dbf8ecc4f4d6092347fdca7c7abaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:00Z,use_quota=True,user_id='a607e0b802ed466a9b4b77451b3774cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d5f96bc-e6e9-4a48-af36-56eb7af70e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d5f96bc-e6e9-4a48-af36-56eb7af70e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352a8761-5128-459b-8d86-c269ed46f7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352a8761-5128-459b-8d86-c269ed46f7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34bf230b-6083-4d26-80fb-9251d9e8178f', 'volume_name': 'volume-34bf230b-6083-4d26-80fb-9251d9e8178f', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26fbf562-93ef-4998-b6bd-021ab8b95780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26fbf562-93ef-4998-b6bd-021ab8b95780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79974895-65be-4033-996e-97c3a87a3618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:06:59 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Volume 34bf230b-6083-4d26-80fb-9251d9e8178f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34bf230b-6083-4d26-80fb-9251d9e8178f', 'volume_size': 1} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34bf230b-6083-4d26-80fb-9251d9e8178f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a3dbf8ecc4f4d6092347fdca7c7abaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:00Z,use_quota=True,user_id='a607e0b802ed466a9b4b77451b3774cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Creating volume 34bf230b-6083-4d26-80fb-9251d9e8178f {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:06:59 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-34bf230b-6083-4d26-80fb-9251d9e8178f 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:06:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fae6687c-5e9b-408d-b1df-e9eb955d1fa1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5" returned: 0 in 0.667s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fae6687c-5e9b-408d-b1df-e9eb955d1fa1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:00 devstack sudo[88152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-34bf230b-6083-4d26-80fb-9251d9e8178f 1073741824 Feb 27 02:07:00 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:00 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5 Feb 27 02:07:00 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:00 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_g5lcfuzvdevstack@QuobyteHD" returned: 0 in 0.739s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:00 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fae6687c-5e9b-408d-b1df-e9eb955d1fa1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eddcf77d-1ccd-4ff1-9e67-626b04020ff5" returned: 0 in 0.569s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:00 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-fae6687c-5e9b-408d-b1df-e9eb955d1fa1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Lock "cinder-quobyte-eddcf77d-1ccd-4ff1-9e67-626b04020ff5" released by "delete_volume" :: held 1.297s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:00 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-fae6687c-5e9b-408d-b1df-e9eb955d1fa1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Created reservations ['ab721cbb-8b74-483e-9c18-77e95e16b6ac', '28bdb0db-2134-438a-a4b7-a30f5f1a9e37', 'f76910ee-6bce-4700-a08a-40ede94a4f55', 'c6778403-9bd0-4284-bf19-107330e09e1a'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:00 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-34bf230b-6083-4d26-80fb-9251d9e8178f 1073741824" returned: 0 in 0.693s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-fae6687c-5e9b-408d-b1df-e9eb955d1fa1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-fae6687c-5e9b-408d-b1df-e9eb955d1fa1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-fae6687c-5e9b-408d-b1df-e9eb955d1fa1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-fae6687c-5e9b-408d-b1df-e9eb955d1fa1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-fae6687c-5e9b-408d-b1df-e9eb955d1fa1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fae6687c-5e9b-408d-b1df-e9eb955d1fa1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:00 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:07:00 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-34bf230b-6083-4d26-80fb-9251d9e8178f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:00 devstack sudo[88166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-34bf230b-6083-4d26-80fb-9251d9e8178f Feb 27 02:07:00 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:01 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-34bf230b-6083-4d26-80fb-9251d9e8178f" returned: 0 in 0.517s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.828s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1752190720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=698596b6-717c-484d-bf55-65862d7e9ed3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e07111062ffc436da7aa27ae6d219d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:06:58Z,use_quota=True,user_id='ee4a42c7c9a24aad92ddd645d91b635d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Creating volume 698596b6-717c-484d-bf55-65862d7e9ed3 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:01 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:07:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:01 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79974895-65be-4033-996e-97c3a87a3618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34bf230b-6083-4d26-80fb-9251d9e8178f', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754af00d-fbad-4483-a57f-ef9e074101ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:01 devstack sudo[88170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3 1073741824 Feb 27 02:07:01 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fae6687c-5e9b-408d-b1df-e9eb955d1fa1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.585s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:01 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-fae6687c-5e9b-408d-b1df-e9eb955d1fa1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:01 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Volume volume-34bf230b-6083-4d26-80fb-9251d9e8178f (34bf230b-6083-4d26-80fb-9251d9e8178f): created successfully Feb 27 02:07:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754af00d-fbad-4483-a57f-ef9e074101ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Flow 'volume_create_manager' (c889d17e-e289-422a-97bd-ec05c050610a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:01 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-fae6687c-5e9b-408d-b1df-e9eb955d1fa1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Deleted volume successfully. Feb 27 02:07:01 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-49b93f61-393d-4e2e-815f-f25f0c494beb tempest-VolumesListAdminTestJSON-699015430 None] Created volume successfully. Feb 27 02:07:01 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-fae6687c-5e9b-408d-b1df-e9eb955d1fa1 tempest-VolumeSnapshotQuotasNegativeTestJSON-2064075124 None] Lock "cinder-eddcf77d-1ccd-4ff1-9e67-626b04020ff5-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:01 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3 1073741824" returned: 0 in 0.665s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:02 devstack sudo[88175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3 Feb 27 02:07:02 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f04c723b-d712-450b-8c07-acf4cec19cde tempest-VolumesListAdminTestJSON-699015430 None] Acquiring lock "cinder-34bf230b-6083-4d26-80fb-9251d9e8178f-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f04c723b-d712-450b-8c07-acf4cec19cde tempest-VolumesListAdminTestJSON-699015430 None] Lock "cinder-34bf230b-6083-4d26-80fb-9251d9e8178f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-81274df2-5693-40b8-949a-be5e6b584fd9 tempest-VolumesListAdminTestJSON-2092363752 None] Acquiring lock "cinder-5cbda092-b9bb-4b87-9aff-4ef6b4dba534-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f04c723b-d712-450b-8c07-acf4cec19cde tempest-VolumesListAdminTestJSON-699015430 None] Acquiring lock "cinder-quobyte-34bf230b-6083-4d26-80fb-9251d9e8178f" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-81274df2-5693-40b8-949a-be5e6b584fd9 tempest-VolumesListAdminTestJSON-2092363752 None] Lock "cinder-5cbda092-b9bb-4b87-9aff-4ef6b4dba534-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f04c723b-d712-450b-8c07-acf4cec19cde tempest-VolumesListAdminTestJSON-699015430 None] Lock "cinder-quobyte-34bf230b-6083-4d26-80fb-9251d9e8178f" acquired by "delete_volume" :: waited 0.044s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fec347-8946-46ec-b85f-396b3b93797d]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f04c723b-d712-450b-8c07-acf4cec19cde tempest-VolumesListAdminTestJSON-699015430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-34bf230b-6083-4d26-80fb-9251d9e8178f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-81274df2-5693-40b8-949a-be5e6b584fd9 tempest-VolumesListAdminTestJSON-2092363752 None] Acquiring lock "cinder-quobyte-5cbda092-b9bb-4b87-9aff-4ef6b4dba534" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-81274df2-5693-40b8-949a-be5e6b584fd9 tempest-VolumesListAdminTestJSON-2092363752 None] Lock "cinder-quobyte-5cbda092-b9bb-4b87-9aff-4ef6b4dba534" acquired by "delete_volume" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceef293-53fc-47ec-a984-b55703c15602]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-81274df2-5693-40b8-949a-be5e6b584fd9 tempest-VolumesListAdminTestJSON-2092363752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5cbda092-b9bb-4b87-9aff-4ef6b4dba534 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:02 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-34bf230b-6083-4d26-80fb-9251d9e8178f Feb 27 02:07:02 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:02 devstack sudo[88178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5cbda092-b9bb-4b87-9aff-4ef6b4dba534 Feb 27 02:07:02 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Flow 'volume_create_manager' (4257a85f-d831-4b24-ab70-48a9538e964f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a004a6c9-5dcd-4f84-bef3-40f54f78e6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a004a6c9-5dcd-4f84-bef3-40f54f78e6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1471637287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a277a2-367f-4063-bd8f-c38bc2e87d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3931fd25df7b4207a0093d5fab43bb1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:02Z,use_quota=True,user_id='28d1dd94e86b449092bf87b598a7c1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec0562a-2c1a-4447-8fd6-5b156aea1d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec0562a-2c1a-4447-8fd6-5b156aea1d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5202100-64f0-428a-8d00-998863c6a071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5202100-64f0-428a-8d00-998863c6a071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38a277a2-367f-4063-bd8f-c38bc2e87d61', 'volume_name': 'volume-38a277a2-367f-4063-bd8f-c38bc2e87d61', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43fee1a5-467e-41eb-a7ac-cd9b339d0362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43fee1a5-467e-41eb-a7ac-cd9b339d0362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d23d075-fd2e-4b22-8d87-374b9902d0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:02 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Volume 38a277a2-367f-4063-bd8f-c38bc2e87d61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38a277a2-367f-4063-bd8f-c38bc2e87d61', 'volume_size': 1} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:02 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3" returned: 0 in 0.736s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.074s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1471637287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a277a2-367f-4063-bd8f-c38bc2e87d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3931fd25df7b4207a0093d5fab43bb1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:02Z,use_quota=True,user_id='28d1dd94e86b449092bf87b598a7c1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Creating volume 38a277a2-367f-4063-bd8f-c38bc2e87d61 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:02 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG cinder.volume.volume_utils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Attempting download of 1936e0bd-39f5-48aa-82e1-d79c80c86062 ((None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}])) to volume 698596b6-717c-484d-bf55-65862d7e9ed3. {{(pid=82683) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 02:07:02 devstack sudo[88182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 1073741824 Feb 27 02:07:02 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[559f9266-7f10-418f-8049-d9294b42186b]: (4, 'raw') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_vdxljek_ {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:02 devstack sudo[88184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_vdxljek_ Feb 27 02:07:02 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:03 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f04c723b-d712-450b-8c07-acf4cec19cde tempest-VolumesListAdminTestJSON-699015430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-34bf230b-6083-4d26-80fb-9251d9e8178f" returned: 0 in 0.857s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f04c723b-d712-450b-8c07-acf4cec19cde tempest-VolumesListAdminTestJSON-699015430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-34bf230b-6083-4d26-80fb-9251d9e8178f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:03 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-81274df2-5693-40b8-949a-be5e6b584fd9 tempest-VolumesListAdminTestJSON-2092363752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5cbda092-b9bb-4b87-9aff-4ef6b4dba534" returned: 0 in 0.810s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-81274df2-5693-40b8-949a-be5e6b584fd9 tempest-VolumesListAdminTestJSON-2092363752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5cbda092-b9bb-4b87-9aff-4ef6b4dba534 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:03 devstack sudo[88193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-34bf230b-6083-4d26-80fb-9251d9e8178f Feb 27 02:07:03 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:03 devstack sudo[88196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5cbda092-b9bb-4b87-9aff-4ef6b4dba534 Feb 27 02:07:03 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:03 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_vdxljek_" returned: 0 in 0.759s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_vdxljek_ {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:03 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 1073741824" returned: 0 in 0.869s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:03 devstack sudo[88202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 Feb 27 02:07:03 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:03 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_vdxljek_ Feb 27 02:07:03 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:03 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f04c723b-d712-450b-8c07-acf4cec19cde tempest-VolumesListAdminTestJSON-699015430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-34bf230b-6083-4d26-80fb-9251d9e8178f" returned: 0 in 0.678s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:03 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-81274df2-5693-40b8-949a-be5e6b584fd9 tempest-VolumesListAdminTestJSON-2092363752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5cbda092-b9bb-4b87-9aff-4ef6b4dba534" returned: 0 in 0.667s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:03 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f04c723b-d712-450b-8c07-acf4cec19cde tempest-VolumesListAdminTestJSON-699015430 None] Lock "cinder-quobyte-34bf230b-6083-4d26-80fb-9251d9e8178f" released by "delete_volume" :: held 1.569s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:03 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-81274df2-5693-40b8-949a-be5e6b584fd9 tempest-VolumesListAdminTestJSON-2092363752 None] Lock "cinder-quobyte-5cbda092-b9bb-4b87-9aff-4ef6b4dba534" released by "delete_volume" :: held 1.513s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:03 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-f04c723b-d712-450b-8c07-acf4cec19cde tempest-VolumesListAdminTestJSON-699015430 None] Created reservations ['930d97f1-0f00-470a-aca8-59df9876ce92', 'c98635ce-ddeb-4b9d-aba8-2c4048421a1d', 'f486c0a6-72a2-4446-9185-8bd9b7ecbef3', '86f06d39-73f1-46ed-8ab1-031dcff0bcf6'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:03 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-81274df2-5693-40b8-949a-be5e6b584fd9 tempest-VolumesListAdminTestJSON-2092363752 None] Created reservations ['e2638a5a-4fd1-44b4-8ad5-863cb6926a5b', 'f3c26d1f-5b5b-46bc-94e1-27cf512b0984', 'f6876f07-9bf5-440e-88fe-4d5d5085f8c9', '50836e81-de71-4826-b2e2-889e6ef1cf44'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f04c723b-d712-450b-8c07-acf4cec19cde tempest-VolumesListAdminTestJSON-699015430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f04c723b-d712-450b-8c07-acf4cec19cde tempest-VolumesListAdminTestJSON-699015430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f04c723b-d712-450b-8c07-acf4cec19cde tempest-VolumesListAdminTestJSON-699015430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f04c723b-d712-450b-8c07-acf4cec19cde tempest-VolumesListAdminTestJSON-699015430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f04c723b-d712-450b-8c07-acf4cec19cde tempest-VolumesListAdminTestJSON-699015430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f04c723b-d712-450b-8c07-acf4cec19cde tempest-VolumesListAdminTestJSON-699015430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-81274df2-5693-40b8-949a-be5e6b584fd9 tempest-VolumesListAdminTestJSON-2092363752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-81274df2-5693-40b8-949a-be5e6b584fd9 tempest-VolumesListAdminTestJSON-2092363752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-81274df2-5693-40b8-949a-be5e6b584fd9 tempest-VolumesListAdminTestJSON-2092363752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:04 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:07:04 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-81274df2-5693-40b8-949a-be5e6b584fd9 tempest-VolumesListAdminTestJSON-2092363752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-81274df2-5693-40b8-949a-be5e6b584fd9 tempest-VolumesListAdminTestJSON-2092363752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-81274df2-5693-40b8-949a-be5e6b584fd9 tempest-VolumesListAdminTestJSON-2092363752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:04 devstack sudo[88210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:07:04 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:04 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61" returned: 0 in 0.575s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d23d075-fd2e-4b22-8d87-374b9902d0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38a277a2-367f-4063-bd8f-c38bc2e87d61', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e46f9d-b99d-4bdb-8592-e1f34572d968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:04 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Volume volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 (38a277a2-367f-4063-bd8f-c38bc2e87d61): created successfully Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60e46f9d-b99d-4bdb-8592-e1f34572d968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Flow 'volume_create_manager' (4257a85f-d831-4b24-ab70-48a9538e964f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:04 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_vdxljek_" returned: 1 in 0.738s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_vdxljek_' failed. Not Retrying. {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[90838a9a-979d-4c10-8dbc-4063b668d107]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:04 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-ab5983ae-50d2-46a0-baaf-db4e95804d44 tempest-VolumeDependencyTests-1347283663 None] Created volume successfully. Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_g5lcfuzvdevstack@QuobyteHD {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:04 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_g5lcfuzvdevstack@QuobyteHD Feb 27 02:07:04 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-be9e6924-d429-48e7-be90-1684f2f4375a tempest-VolumesListAdminTestJSON-2092363752 None] Acquiring lock "cinder-24dfe335-be1c-48fe-bd50-349006911453-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-be9e6924-d429-48e7-be90-1684f2f4375a tempest-VolumesListAdminTestJSON-2092363752 None] Lock "cinder-24dfe335-be1c-48fe-bd50-349006911453-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-be9e6924-d429-48e7-be90-1684f2f4375a tempest-VolumesListAdminTestJSON-2092363752 None] Acquiring lock "cinder-quobyte-24dfe335-be1c-48fe-bd50-349006911453" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-be9e6924-d429-48e7-be90-1684f2f4375a tempest-VolumesListAdminTestJSON-2092363752 None] Lock "cinder-quobyte-24dfe335-be1c-48fe-bd50-349006911453" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5b974a-f103-487b-b1f2-0505e50aae5e]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-be9e6924-d429-48e7-be90-1684f2f4375a tempest-VolumesListAdminTestJSON-2092363752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-24dfe335-be1c-48fe-bd50-349006911453 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:04 devstack sudo[88216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-24dfe335-be1c-48fe-bd50-349006911453 Feb 27 02:07:04 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:04 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-81274df2-5693-40b8-949a-be5e6b584fd9 tempest-VolumesListAdminTestJSON-2092363752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.621s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-81274df2-5693-40b8-949a-be5e6b584fd9 tempest-VolumesListAdminTestJSON-2092363752 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:04 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-81274df2-5693-40b8-949a-be5e6b584fd9 tempest-VolumesListAdminTestJSON-2092363752 None] Deleted volume successfully. Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-81274df2-5693-40b8-949a-be5e6b584fd9 tempest-VolumesListAdminTestJSON-2092363752 None] Lock "cinder-5cbda092-b9bb-4b87-9aff-4ef6b4dba534-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:04 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f04c723b-d712-450b-8c07-acf4cec19cde tempest-VolumesListAdminTestJSON-699015430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.787s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-f04c723b-d712-450b-8c07-acf4cec19cde tempest-VolumesListAdminTestJSON-699015430 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:04 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-f04c723b-d712-450b-8c07-acf4cec19cde tempest-VolumesListAdminTestJSON-699015430 None] Deleted volume successfully. Feb 27 02:07:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f04c723b-d712-450b-8c07-acf4cec19cde tempest-VolumesListAdminTestJSON-699015430 None] Lock "cinder-34bf230b-6083-4d26-80fb-9251d9e8178f-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-15ce35a1-662f-4824-9d77-584116e04f61 tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-15ce35a1-662f-4824-9d77-584116e04f61 tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:05 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-15ce35a1-662f-4824-9d77-584116e04f61 tempest-VolumeDependencyTests-1347283663 None] Creating offline snapshot 76d43a22-ffdc-48e4-83b3-c5487b596877 of volume 38a277a2-367f-4063-bd8f-c38bc2e87d61 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:05 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7fe4d5-6536-4103-a9a8-a42a30d0b35f]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-15ce35a1-662f-4824-9d77-584116e04f61 tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:05 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_g5lcfuzvdevstack@QuobyteHD" returned: 0 in 0.763s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:05 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] 1936e0bd-39f5-48aa-82e1-d79c80c86062 was qcow2, converting to raw {{(pid=82683) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 02:07:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_g5lcfuzvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:05 devstack sudo[88224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_g5lcfuzvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3 Feb 27 02:07:05 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:05 devstack sudo[88223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 Feb 27 02:07:05 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:05 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-be9e6924-d429-48e7-be90-1684f2f4375a tempest-VolumesListAdminTestJSON-2092363752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-24dfe335-be1c-48fe-bd50-349006911453" returned: 0 in 0.744s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-be9e6924-d429-48e7-be90-1684f2f4375a tempest-VolumesListAdminTestJSON-2092363752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-24dfe335-be1c-48fe-bd50-349006911453 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:05 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-24dfe335-be1c-48fe-bd50-349006911453 Feb 27 02:07:05 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:05 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-15ce35a1-662f-4824-9d77-584116e04f61 tempest-VolumeDependencyTests-1347283663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61" returned: 0 in 0.585s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-15ce35a1-662f-4824-9d77-584116e04f61 tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:05 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877 1G Feb 27 02:07:05 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:06 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-be9e6924-d429-48e7-be90-1684f2f4375a tempest-VolumesListAdminTestJSON-2092363752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-24dfe335-be1c-48fe-bd50-349006911453" returned: 0 in 0.634s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-be9e6924-d429-48e7-be90-1684f2f4375a tempest-VolumesListAdminTestJSON-2092363752 None] Lock "cinder-quobyte-24dfe335-be1c-48fe-bd50-349006911453" released by "delete_volume" :: held 1.404s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:06 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-be9e6924-d429-48e7-be90-1684f2f4375a tempest-VolumesListAdminTestJSON-2092363752 None] Created reservations ['364c4dd9-1e33-443e-bf2e-a65be1d8ad8f', '53021da3-5483-4fa2-97f8-5d12624a582c', 'b8f253cf-d76b-457d-b1e6-2cb1048f895e', 'e1c60aab-0f68-425f-b1a1-bff975d1fc22'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-be9e6924-d429-48e7-be90-1684f2f4375a tempest-VolumesListAdminTestJSON-2092363752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-be9e6924-d429-48e7-be90-1684f2f4375a tempest-VolumesListAdminTestJSON-2092363752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:06 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-be9e6924-d429-48e7-be90-1684f2f4375a tempest-VolumesListAdminTestJSON-2092363752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:06 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-be9e6924-d429-48e7-be90-1684f2f4375a tempest-VolumesListAdminTestJSON-2092363752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-be9e6924-d429-48e7-be90-1684f2f4375a tempest-VolumesListAdminTestJSON-2092363752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-be9e6924-d429-48e7-be90-1684f2f4375a tempest-VolumesListAdminTestJSON-2092363752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:06 devstack sudo[88245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:07:06 devstack sudo[88245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:06 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-15ce35a1-662f-4824-9d77-584116e04f61 tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877 1G" returned: 0 in 0.663s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-15ce35a1-662f-4824-9d77-584116e04f61 tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:06 devstack sudo[88248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877 Feb 27 02:07:06 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:06 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_g5lcfuzvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3" returned: 0 in 1.426s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:06 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_g5lcfuzvdevstack@QuobyteHD, size 112.00 MB, duration 1.43 sec, destination /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3 {{(pid=82683) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:07:06 devstack cinder-volume[82683]: INFO cinder.image.image_utils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Converted 112.00 MB image at 78.44 MB/s Feb 27 02:07:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:06 devstack sudo[88282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3 1G Feb 27 02:07:06 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:06 devstack sudo[88245]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-be9e6924-d429-48e7-be90-1684f2f4375a tempest-VolumesListAdminTestJSON-2092363752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.782s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:06 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-be9e6924-d429-48e7-be90-1684f2f4375a tempest-VolumesListAdminTestJSON-2092363752 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:06 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-be9e6924-d429-48e7-be90-1684f2f4375a tempest-VolumesListAdminTestJSON-2092363752 None] Deleted volume successfully. Feb 27 02:07:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8137f191-ee36-460a-b8cb-b862d3f343e1 tempest-VolumesListAdminTestJSON-2092363752 None] Acquiring lock "cinder-03f55124-ac89-44b7-94c1-c4f098e0593a-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-be9e6924-d429-48e7-be90-1684f2f4375a tempest-VolumesListAdminTestJSON-2092363752 None] Lock "cinder-24dfe335-be1c-48fe-bd50-349006911453-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8137f191-ee36-460a-b8cb-b862d3f343e1 tempest-VolumesListAdminTestJSON-2092363752 None] Lock "cinder-03f55124-ac89-44b7-94c1-c4f098e0593a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:07 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-15ce35a1-662f-4824-9d77-584116e04f61 tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877" returned: 0 in 0.725s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:07 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-15ce35a1-662f-4824-9d77-584116e04f61 tempest-VolumeDependencyTests-1347283663 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877 is being set with open permissions: ugo+rw Feb 27 02:07:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-15ce35a1-662f-4824-9d77-584116e04f61 tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:07 devstack sudo[88290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877 Feb 27 02:07:07 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8137f191-ee36-460a-b8cb-b862d3f343e1 tempest-VolumesListAdminTestJSON-2092363752 None] Acquiring lock "cinder-quobyte-03f55124-ac89-44b7-94c1-c4f098e0593a" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8137f191-ee36-460a-b8cb-b862d3f343e1 tempest-VolumesListAdminTestJSON-2092363752 None] Lock "cinder-quobyte-03f55124-ac89-44b7-94c1-c4f098e0593a" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:07 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2f802f-2e6d-4158-a56d-391094275ec8]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8137f191-ee36-460a-b8cb-b862d3f343e1 tempest-VolumesListAdminTestJSON-2092363752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-03f55124-ac89-44b7-94c1-c4f098e0593a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:07 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-03f55124-ac89-44b7-94c1-c4f098e0593a Feb 27 02:07:07 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:07 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3 1G" returned: 0 in 0.692s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:07 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc3b27e-9b40-46c0-ace3-c9957b3a97ad]: (4, 'raw') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:07 devstack sudo[88297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3 Feb 27 02:07:07 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:07 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-15ce35a1-662f-4824-9d77-584116e04f61 tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877" returned: 0 in 0.506s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-15ce35a1-662f-4824-9d77-584116e04f61 tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:07 devstack sudo[88300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.info Feb 27 02:07:07 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:07 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8137f191-ee36-460a-b8cb-b862d3f343e1 tempest-VolumesListAdminTestJSON-2092363752 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-03f55124-ac89-44b7-94c1-c4f098e0593a" returned: 0 in 0.656s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8137f191-ee36-460a-b8cb-b862d3f343e1 tempest-VolumesListAdminTestJSON-2092363752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-03f55124-ac89-44b7-94c1-c4f098e0593a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:07 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-03f55124-ac89-44b7-94c1-c4f098e0593a Feb 27 02:07:07 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:07 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3" returned: 0 in 0.596s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:08 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3 Feb 27 02:07:08 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:08 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-15ce35a1-662f-4824-9d77-584116e04f61 tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.info" returned: 0 in 0.621s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:08 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-15ce35a1-662f-4824-9d77-584116e04f61 tempest-VolumeDependencyTests-1347283663 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.info is being set with open permissions: ugo+rw Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-15ce35a1-662f-4824-9d77-584116e04f61 tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:08 devstack sudo[88320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.info Feb 27 02:07:08 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:08 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8137f191-ee36-460a-b8cb-b862d3f343e1 tempest-VolumesListAdminTestJSON-2092363752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-03f55124-ac89-44b7-94c1-c4f098e0593a" returned: 0 in 0.591s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8137f191-ee36-460a-b8cb-b862d3f343e1 tempest-VolumesListAdminTestJSON-2092363752 None] Lock "cinder-quobyte-03f55124-ac89-44b7-94c1-c4f098e0593a" released by "delete_volume" :: held 1.273s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-8137f191-ee36-460a-b8cb-b862d3f343e1 tempest-VolumesListAdminTestJSON-2092363752 None] Created reservations ['80685482-d2d1-46c4-9f2f-006c99b8240c', 'f8fa0d7e-a9cf-4278-8631-71ec5a58b6af', '2bce5821-ae7e-4f5f-91e1-778c737193eb', '0602b178-e435-491e-9151-65a496c1cf35'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8137f191-ee36-460a-b8cb-b862d3f343e1 tempest-VolumesListAdminTestJSON-2092363752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8137f191-ee36-460a-b8cb-b862d3f343e1 tempest-VolumesListAdminTestJSON-2092363752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8137f191-ee36-460a-b8cb-b862d3f343e1 tempest-VolumesListAdminTestJSON-2092363752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8137f191-ee36-460a-b8cb-b862d3f343e1 tempest-VolumesListAdminTestJSON-2092363752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8137f191-ee36-460a-b8cb-b862d3f343e1 tempest-VolumesListAdminTestJSON-2092363752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8137f191-ee36-460a-b8cb-b862d3f343e1 tempest-VolumesListAdminTestJSON-2092363752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:08 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3" returned: 1 in 0.674s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3' failed. Not Retrying. {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG cinder.volume.volume_utils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Downloaded image 1936e0bd-39f5-48aa-82e1-d79c80c86062 ((None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}])) to volume 698596b6-717c-484d-bf55-65862d7e9ed3 successfully. {{(pid=82683) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Temporary image 1936e0bd-39f5-48aa-82e1-d79c80c86062 for user ee4a42c7c9a24aad92ddd645d91b635d is deleted. {{(pid=82683) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG cinder.volume.volume_utils [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Marking volume 698596b6-717c-484d-bf55-65862d7e9ed3 as bootable. {{(pid=82683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 02:07:08 devstack sudo[88325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:07:08 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Copying metadata from image 1936e0bd-39f5-48aa-82e1-d79c80c86062 to 698596b6-717c-484d-bf55-65862d7e9ed3. {{(pid=82683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Creating volume glance metadata for volume 698596b6-717c-484d-bf55-65862d7e9ed3 backed by image 1936e0bd-39f5-48aa-82e1-d79c80c86062 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82683) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01363215-51f7-44d1-a3ac-f84656a2b5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-698596b6-717c-484d-bf55-65862d7e9ed3', 'volume_size': 1, 'image_id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '757f43b353254b8d946a078a47db0c70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1936e0bd-39f5-48aa-82e1-d79c80c86062/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef07dd0f-2e3b-493e-bbe5-0fbb3f973b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:08 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Volume volume-698596b6-717c-484d-bf55-65862d7e9ed3 (698596b6-717c-484d-bf55-65862d7e9ed3): created successfully Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef07dd0f-2e3b-493e-bbe5-0fbb3f973b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Flow 'volume_create_manager' (7d138296-58e1-434b-a24c-db4d419d0096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:08 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-987a9da6-6700-4c23-9516-4f035ae3c722 tempest-VolumesGetTest-1784211569 None] Created volume successfully. Feb 27 02:07:08 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-15ce35a1-662f-4824-9d77-584116e04f61 tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.info" returned: 0 in 0.586s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-15ce35a1-662f-4824-9d77-584116e04f61 tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.771s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:08 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-15ce35a1-662f-4824-9d77-584116e04f61 tempest-VolumeDependencyTests-1347283663 None] Create snapshot completed successfully Feb 27 02:07:09 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8137f191-ee36-460a-b8cb-b862d3f343e1 tempest-VolumesListAdminTestJSON-2092363752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.480s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:09 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-8137f191-ee36-460a-b8cb-b862d3f343e1 tempest-VolumesListAdminTestJSON-2092363752 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:09 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-8137f191-ee36-460a-b8cb-b862d3f343e1 tempest-VolumesListAdminTestJSON-2092363752 None] Deleted volume successfully. Feb 27 02:07:09 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8137f191-ee36-460a-b8cb-b862d3f343e1 tempest-VolumesListAdminTestJSON-2092363752 None] Lock "cinder-03f55124-ac89-44b7-94c1-c4f098e0593a-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:09 devstack cinder-volume[82683]: DEBUG oslo_service.periodic_task [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:07:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:09 devstack sudo[88329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:07:09 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:09 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:09 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Flow 'volume_create_manager' (19a58059-d01b-4d6a-a8ba-fc0ba3839a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7853f7-17b1-4b1d-a673-23581f49151e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7853f7-17b1-4b1d-a673-23581f49151e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1248260472',display_name='tempest-VolumesGetTest-Volume-1047474882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18caa62-5afc-4583-b00b-6ad979abc69f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07111062ffc436da7aa27ae6d219d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:10Z,use_quota=True,user_id='ee4a42c7c9a24aad92ddd645d91b635d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85aa133b-ec76-4324-99b8-a02827f870c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85aa133b-ec76-4324-99b8-a02827f870c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf66907-675d-4024-87c2-66f51d480a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf66907-675d-4024-87c2-66f51d480a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18caa62-5afc-4583-b00b-6ad979abc69f', 'volume_name': 'volume-b18caa62-5afc-4583-b00b-6ad979abc69f', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f646896-0bd0-4a75-9717-eaf4467102c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f646896-0bd0-4a75-9717-eaf4467102c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321ffcc7-f7f9-443b-9ffb-8829c308fc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:10 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Volume b18caa62-5afc-4583-b00b-6ad979abc69f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18caa62-5afc-4583-b00b-6ad979abc69f', 'volume_size': 1} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1248260472',display_name='tempest-VolumesGetTest-Volume-1047474882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18caa62-5afc-4583-b00b-6ad979abc69f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07111062ffc436da7aa27ae6d219d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:10Z,use_quota=True,user_id='ee4a42c7c9a24aad92ddd645d91b635d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Creating volume b18caa62-5afc-4583-b00b-6ad979abc69f {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:10 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:10 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b18caa62-5afc-4583-b00b-6ad979abc69f 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:10 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b18caa62-5afc-4583-b00b-6ad979abc69f 1073741824 Feb 27 02:07:10 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.755s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Flow 'volume_create_manager' (afa8d39a-6cff-414b-8e1e-573603ec9ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2002c1bf-5e46-4a53-8b55-a6b1995ef71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2002c1bf-5e46-4a53-8b55-a6b1995ef71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1607956098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=773e53f5-29cb-423b-8d0e-a72d8fe1c2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3931fd25df7b4207a0093d5fab43bb1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=76d43a22-ffdc-48e4-83b3-c5487b596877,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:10Z,use_quota=True,user_id='28d1dd94e86b449092bf87b598a7c1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1aa5e3-f112-4eba-9e29-240eccc8a227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1aa5e3-f112-4eba-9e29-240eccc8a227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4bcfb16-8ad8-4993-9a7d-7d2396de2fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4bcfb16-8ad8-4993-9a7d-7d2396de2fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '773e53f5-29cb-423b-8d0e-a72d8fe1c2f6', 'volume_name': 'volume-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6', 'volume_size': 1, 'snapshot_id': '76d43a22-ffdc-48e4-83b3-c5487b596877'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0376d5b-665c-4ba2-85e1-5c177733bb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0376d5b-665c-4ba2-85e1-5c177733bb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c53401-3e62-4c29-a24b-630cebcca4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:10 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Volume 773e53f5-29cb-423b-8d0e-a72d8fe1c2f6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6', 'volume_size': 1, 'snapshot_id': '76d43a22-ffdc-48e4-83b3-c5487b596877'} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:10 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b18caa62-5afc-4583-b00b-6ad979abc69f 1073741824" returned: 0 in 0.791s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b18caa62-5afc-4583-b00b-6ad979abc69f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:10 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b18caa62-5afc-4583-b00b-6ad979abc69f Feb 27 02:07:10 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:11 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b18caa62-5afc-4583-b00b-6ad979abc69f" returned: 0 in 0.624s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.254s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "cinder-quobyte-76d43a22-ffdc-48e4-83b3-c5487b596877-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6" by "_create_volume_from_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:INSERT=64,cinder:UPDATE=273,cinder:SELECT=182,cinder:DELETE=22 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321ffcc7-f7f9-443b-9ffb-8829c308fc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18caa62-5afc-4583-b00b-6ad979abc69f', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aaccdce-634c-4b7e-9036-51542f6a1481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-quobyte-76d43a22-ffdc-48e4-83b3-c5487b596877-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Creating volume 773e53f5-29cb-423b-8d0e-a72d8fe1c2f6 from snapshot 76d43a22-ffdc-48e4-83b3-c5487b596877 {{(pid=82683) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "cinder-quobyte-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6" by "_copy_volume_from_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:11 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Volume volume-b18caa62-5afc-4583-b00b-6ad979abc69f (b18caa62-5afc-4583-b00b-6ad979abc69f): created successfully Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aaccdce-634c-4b7e-9036-51542f6a1481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Flow 'volume_create_manager' (19a58059-d01b-4d6a-a8ba-fc0ba3839a14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-quobyte-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] snapshot: 76d43a22-ffdc-48e4-83b3-c5487b596877, volume: 773e53f5-29cb-423b-8d0e-a72d8fe1c2f6, {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:11 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-ba4265f7-33b0-4899-9fe3-be064d6dad6b tempest-VolumesGetTest-1784211569 None] Created volume successfully. Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7931de-e6b1-4b17-8870-a7ccd6a813b3]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:11 devstack sudo[88340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877 Feb 27 02:07:11 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-76e8890a-0561-4948-8132-1d12f719549e tempest-VolumesGetTest-1784211569 None] Acquiring lock "cinder-b18caa62-5afc-4583-b00b-6ad979abc69f-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-76e8890a-0561-4948-8132-1d12f719549e tempest-VolumesGetTest-1784211569 None] Lock "cinder-b18caa62-5afc-4583-b00b-6ad979abc69f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-76e8890a-0561-4948-8132-1d12f719549e tempest-VolumesGetTest-1784211569 None] Acquiring lock "cinder-quobyte-b18caa62-5afc-4583-b00b-6ad979abc69f" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-76e8890a-0561-4948-8132-1d12f719549e tempest-VolumesGetTest-1784211569 None] Lock "cinder-quobyte-b18caa62-5afc-4583-b00b-6ad979abc69f" acquired by "delete_volume" :: waited 0.027s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:12 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d98f8f-606a-4619-abb4-8c98b9463190]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-76e8890a-0561-4948-8132-1d12f719549e tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b18caa62-5afc-4583-b00b-6ad979abc69f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:12 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877" returned: 0 in 0.764s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:12 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38a277a2-367f-4063-bd8f-c38bc2e87d61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:12 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] will copy from snapshot at /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:07:12 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Creating direct copy from snapshot {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:07:12 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa94304-5507-4a81-8d5b-b37b5f924604]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:12 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b18caa62-5afc-4583-b00b-6ad979abc69f Feb 27 02:07:12 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:12 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 Feb 27 02:07:12 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:13 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-76e8890a-0561-4948-8132-1d12f719549e tempest-VolumesGetTest-1784211569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b18caa62-5afc-4583-b00b-6ad979abc69f" returned: 0 in 0.707s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-76e8890a-0561-4948-8132-1d12f719549e tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b18caa62-5afc-4583-b00b-6ad979abc69f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:13 devstack sudo[88355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b18caa62-5afc-4583-b00b-6ad979abc69f Feb 27 02:07:13 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:13 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61" returned: 0 in 0.732s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:13 devstack cinder-volume[82683]: DEBUG cinder.utils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Path /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6 not found in is_blk_device check {{(pid=82683) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:07:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:13 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6 Feb 27 02:07:13 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:13 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-76e8890a-0561-4948-8132-1d12f719549e tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b18caa62-5afc-4583-b00b-6ad979abc69f" returned: 0 in 0.592s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-76e8890a-0561-4948-8132-1d12f719549e tempest-VolumesGetTest-1784211569 None] Lock "cinder-quobyte-b18caa62-5afc-4583-b00b-6ad979abc69f" released by "delete_volume" :: held 1.344s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:13 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-76e8890a-0561-4948-8132-1d12f719549e tempest-VolumesGetTest-1784211569 None] Created reservations ['771fbc9b-287a-4a00-a633-e3d4150fb189', '1b0b9fbd-6a5b-4163-9287-70574e1f5c27', '0f99aa71-455e-4138-be61-106ac601a7ad', 'ca6123d9-3a42-4edf-892f-0ab33ab651bf'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-76e8890a-0561-4948-8132-1d12f719549e tempest-VolumesGetTest-1784211569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-76e8890a-0561-4948-8132-1d12f719549e tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-76e8890a-0561-4948-8132-1d12f719549e tempest-VolumesGetTest-1784211569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-76e8890a-0561-4948-8132-1d12f719549e tempest-VolumesGetTest-1784211569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-76e8890a-0561-4948-8132-1d12f719549e tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-76e8890a-0561-4948-8132-1d12f719549e tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:13 devstack sudo[88363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:07:13 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:14 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] Acquiring lock "cinder-698596b6-717c-484d-bf55-65862d7e9ed3-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] Lock "cinder-698596b6-717c-484d-bf55-65862d7e9ed3-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:15 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:UPDATE=229,cinder:SELECT=174,cinder:DELETE=21,cinder:INSERT=63 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:07:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] Acquiring lock "cinder-quobyte-698596b6-717c-484d-bf55-65862d7e9ed3" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] Lock "cinder-quobyte-698596b6-717c-484d-bf55-65862d7e9ed3" acquired by "delete_volume" :: waited 0.030s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:15 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea1e16a-231d-478f-a0a7-62f393eff3ec]: (4, 'raw') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:16 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:16 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3 Feb 27 02:07:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-76e8890a-0561-4948-8132-1d12f719549e tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 2.252s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:16 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:16 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-76e8890a-0561-4948-8132-1d12f719549e tempest-VolumesGetTest-1784211569 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:16 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-76e8890a-0561-4948-8132-1d12f719549e tempest-VolumesGetTest-1784211569 None] Deleted volume successfully. Feb 27 02:07:16 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-76e8890a-0561-4948-8132-1d12f719549e tempest-VolumesGetTest-1784211569 None] Lock "cinder-b18caa62-5afc-4583-b00b-6ad979abc69f-delete_volume" released by "delete_volume" :: held 3.840s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:16 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6" returned: 0 in 3.112s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:16 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d540b44-5892-4782-9582-5fddef221a40]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:16 devstack sudo[88375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 Feb 27 02:07:16 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:16 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3" returned: 0 in 1.160s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:16 devstack sudo[88379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3 Feb 27 02:07:16 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:17 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61" returned: 0 in 0.776s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:17 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Image conversion details: src /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61, size 1024.00 MB, duration 3.11 sec, destination /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6 {{(pid=82683) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:07:17 devstack cinder-volume[82683]: INFO cinder.image.image_utils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Converted 1024.00 MB image at 328.93 MB/s Feb 27 02:07:17 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6 is being set with open permissions: ugo+rw Feb 27 02:07:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:17 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6 Feb 27 02:07:17 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:17 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3" returned: 1 in 0.675s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3' failed. Not Retrying. {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:07:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:17 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3 Feb 27 02:07:17 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:17 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6" returned: 0 in 0.649s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:17 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-quobyte-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6" released by "_copy_volume_from_snapshot" :: held 6.110s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:17 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-quobyte-76d43a22-ffdc-48e4-83b3-c5487b596877-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6" released by "_create_volume_from_snapshot" :: held 6.164s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.210s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:17 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c53401-3e62-4c29-a24b-630cebcca4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6', 'volume_size': 1, 'snapshot_id': '76d43a22-ffdc-48e4-83b3-c5487b596877'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:17 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3e8f98-7510-4010-a11d-68a42bc59d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:17 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Volume volume-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6 (773e53f5-29cb-423b-8d0e-a72d8fe1c2f6): created successfully Feb 27 02:07:17 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3e8f98-7510-4010-a11d-68a42bc59d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:17 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Flow 'volume_create_manager' (afa8d39a-6cff-414b-8e1e-573603ec9ef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:17 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-d45733b7-2df0-41ff-9bae-08e389d042ba tempest-VolumeDependencyTests-1347283663 None] Created volume successfully. Feb 27 02:07:17 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-698596b6-717c-484d-bf55-65862d7e9ed3" returned: 0 in 0.573s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:17 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] Lock "cinder-quobyte-698596b6-717c-484d-bf55-65862d7e9ed3" released by "delete_volume" :: held 2.530s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:18 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] Created reservations ['b5e419a7-fd32-4fe0-912d-742147488b56', '252eb1f8-db61-4dbb-904e-03eb14197995', '971c24e7-2fde-4ed6-9002-23e842c5b835', 'cfc7d5d8-5c35-400f-8865-90a4b6f26661'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:18 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:18 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:18 devstack sudo[88393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:07:18 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:18 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.700s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:18 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:18 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] Deleted volume successfully. Feb 27 02:07:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ad69db28-b8c0-4433-9cea-4c455b1a1fa9 tempest-VolumesGetTest-1784211569 None] Lock "cinder-698596b6-717c-484d-bf55-65862d7e9ed3-delete_volume" released by "delete_volume" :: held 3.811s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "cinder-76d43a22-ffdc-48e4-83b3-c5487b596877-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:19 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-76d43a22-ffdc-48e4-83b3-c5487b596877-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:19 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "cinder-quobyte-38a277a2-367f-4063-bd8f-c38bc2e87d61" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:19 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-quobyte-38a277a2-367f-4063-bd8f-c38bc2e87d61" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:19 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "cinder-quobyte-76d43a22-ffdc-48e4-83b3-c5487b596877" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:19 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-quobyte-76d43a22-ffdc-48e4-83b3-c5487b596877" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] Deleting offline snapshot 76d43a22-ffdc-48e4-83b3-c5487b596877 of volume 38a277a2-367f-4063-bd8f-c38bc2e87d61 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] snapshot_file for this snap is: volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:19 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b067d1f-5c4a-470f-8c86-52145df1e3bf]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:19 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877 Feb 27 02:07:19 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:19 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877" returned: 0 in 0.830s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38a277a2-367f-4063-bd8f-c38bc2e87d61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:19 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0206951a-82d5-49ff-bf6f-7d1397305b14]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:20 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 Feb 27 02:07:20 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Flow 'volume_create_manager' (e5e0d299-5b22-4736-9b23-b8daf8791478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fea41f9-9bfa-470e-a926-cc5108cc0ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fea41f9-9bfa-470e-a926-cc5108cc0ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1810186786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f2aa9b-a34d-4bfb-b620-30805b729777,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d41029d7cf3413191a8bb31b19a24bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:20Z,use_quota=True,user_id='1d5e68d6dc144ad5ab71e82c055cb8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72ffee4-1f9a-412f-9e8c-bb0c0b7e5753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72ffee4-1f9a-412f-9e8c-bb0c0b7e5753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17221b9d-41b8-4da6-970a-282b520a4e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17221b9d-41b8-4da6-970a-282b520a4e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02f2aa9b-a34d-4bfb-b620-30805b729777', 'volume_name': 'volume-02f2aa9b-a34d-4bfb-b620-30805b729777', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61145e4-c40f-4efb-aadb-0c9bbf6cdafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61145e4-c40f-4efb-aadb-0c9bbf6cdafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e46b47-ed24-46de-a0d5-e958afd6bda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:20 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Volume 02f2aa9b-a34d-4bfb-b620-30805b729777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02f2aa9b-a34d-4bfb-b620-30805b729777', 'volume_size': 1} Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1810186786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f2aa9b-a34d-4bfb-b620-30805b729777,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d41029d7cf3413191a8bb31b19a24bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:20Z,use_quota=True,user_id='1d5e68d6dc144ad5ab71e82c055cb8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Creating volume 02f2aa9b-a34d-4bfb-b620-30805b729777 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:20 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-02f2aa9b-a34d-4bfb-b620-30805b729777 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:20 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-02f2aa9b-a34d-4bfb-b620-30805b729777 1073741824 Feb 27 02:07:20 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:20 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61" returned: 0 in 0.795s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:20 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877 Feb 27 02:07:20 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:21 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-02f2aa9b-a34d-4bfb-b620-30805b729777 1073741824" returned: 0 in 0.947s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-02f2aa9b-a34d-4bfb-b620-30805b729777 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:21 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-02f2aa9b-a34d-4bfb-b620-30805b729777 Feb 27 02:07:21 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:21 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877" returned: 0 in 0.858s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:21 devstack sudo[88422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877 Feb 27 02:07:21 devstack sudo[88422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:22 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-02f2aa9b-a34d-4bfb-b620-30805b729777" returned: 0 in 0.648s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e46b47-ed24-46de-a0d5-e958afd6bda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02f2aa9b-a34d-4bfb-b620-30805b729777', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f2e2f6b-4fe7-4426-8e4e-d306262e455c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Volume volume-02f2aa9b-a34d-4bfb-b620-30805b729777 (02f2aa9b-a34d-4bfb-b620-30805b729777): created successfully Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f2e2f6b-4fe7-4426-8e4e-d306262e455c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Flow 'volume_create_manager' (e5e0d299-5b22-4736-9b23-b8daf8791478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:22 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-039e9b03-ac71-44ff-b438-f06abb081952 tempest-VolumesListTestJSON-678901916 None] Created volume successfully. Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Flow 'volume_create_manager' (ad3c1930-b2c4-4b08-9105-91200bb102d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ab5a40-1adf-43ec-ac01-89eb99f4e075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3ab5a40-1adf-43ec-ac01-89eb99f4e075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-41775207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87dd002e6bba485e86eedd21fa681622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:22Z,use_quota=True,user_id='018e6d7aa076454baed31cd42fab847a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018ffaa0-15c7-4380-9361-d9291a0dd526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018ffaa0-15c7-4380-9361-d9291a0dd526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85475265-359f-49db-a05a-25cfc7ea1b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85475265-359f-49db-a05a-25cfc7ea1b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42', 'volume_name': 'volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:22 devstack sudo[88422]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (007c6cac-4537-47ed-9724-9f18f637e30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (007c6cac-4537-47ed-9724-9f18f637e30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057889c3-dc4f-46f2-b046-1a296b22e11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Volume 17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42', 'volume_size': 1} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-41775207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87dd002e6bba485e86eedd21fa681622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:22Z,use_quota=True,user_id='018e6d7aa076454baed31cd42fab847a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Creating volume 17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:22 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61.76d43a22-ffdc-48e4-83b3-c5487b596877" returned: 0 in 0.811s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:22 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 1073741824 Feb 27 02:07:22 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-quobyte-76d43a22-ffdc-48e4-83b3-c5487b596877" released by "_delete_snapshot" :: held 3.409s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-quobyte-38a277a2-367f-4063-bd8f-c38bc2e87d61" released by "delete_snapshot" :: held 3.461s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] Created reservations ['9f0a95a7-d0c5-4620-a8b7-cc119dfb583b', '21788953-50e0-44bf-9f45-cfe50c80970b', '5434adc2-51fe-4995-a381-d1e275c40829', '61a53ba0-c826-4ceb-97aa-8cbd478b963e'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:22 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] Delete snapshot completed successfully. Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-07f6750a-c8a7-4917-8bad-13fdf2d8c83f tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-76d43a22-ffdc-48e4-83b3-c5487b596877-delete_snapshot" released by "delete_snapshot" :: held 3.603s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Flow 'volume_create_manager' (ae917df3-0ba0-4bb7-9c3a-9d6728c38740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6014cee4-20ec-4dee-ab27-d7cac6734eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6014cee4-20ec-4dee-ab27-d7cac6734eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-164678779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded3fcae-9db1-4624-8b66-675a5ed73953,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d41029d7cf3413191a8bb31b19a24bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:23Z,use_quota=True,user_id='1d5e68d6dc144ad5ab71e82c055cb8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87961c9d-5aad-4639-bfb0-f2ae13403daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87961c9d-5aad-4639-bfb0-f2ae13403daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb2ed07-5b77-46a1-85d1-6987aeb97a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb2ed07-5b77-46a1-85d1-6987aeb97a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ded3fcae-9db1-4624-8b66-675a5ed73953', 'volume_name': 'volume-ded3fcae-9db1-4624-8b66-675a5ed73953', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103803b1-2d18-4b6a-9147-2a8ec21f054a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103803b1-2d18-4b6a-9147-2a8ec21f054a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62808bb5-4ee7-43fd-a0ed-310188cb3e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:22 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Volume ded3fcae-9db1-4624-8b66-675a5ed73953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ded3fcae-9db1-4624-8b66-675a5ed73953', 'volume_size': 1} Feb 27 02:07:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:23 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 1073741824" returned: 0 in 0.737s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:23 devstack sudo[88431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 Feb 27 02:07:23 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8745153b-9e54-4e67-9b39-4cf317257e5f tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "cinder-38a277a2-367f-4063-bd8f-c38bc2e87d61-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8745153b-9e54-4e67-9b39-4cf317257e5f tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-38a277a2-367f-4063-bd8f-c38bc2e87d61-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8745153b-9e54-4e67-9b39-4cf317257e5f tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "cinder-quobyte-38a277a2-367f-4063-bd8f-c38bc2e87d61" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8745153b-9e54-4e67-9b39-4cf317257e5f tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-quobyte-38a277a2-367f-4063-bd8f-c38bc2e87d61" acquired by "delete_volume" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a87e94-ce55-4b04-a439-9e3025a37045]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8745153b-9e54-4e67-9b39-4cf317257e5f tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:23 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 Feb 27 02:07:23 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:23 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42" returned: 0 in 0.523s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.803s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-164678779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded3fcae-9db1-4624-8b66-675a5ed73953,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d41029d7cf3413191a8bb31b19a24bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:23Z,use_quota=True,user_id='1d5e68d6dc144ad5ab71e82c055cb8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Creating volume ded3fcae-9db1-4624-8b66-675a5ed73953 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:23 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ded3fcae-9db1-4624-8b66-675a5ed73953 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057889c3-dc4f-46f2-b046-1a296b22e11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:23 devstack sudo[88436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ded3fcae-9db1-4624-8b66-675a5ed73953 1073741824 Feb 27 02:07:23 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671bd8b9-61f9-49d8-9016-0b2da6d29504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:23 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Volume volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 (17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42): created successfully Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671bd8b9-61f9-49d8-9016-0b2da6d29504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:23 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Flow 'volume_create_manager' (ad3c1930-b2c4-4b08-9105-91200bb102d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:23 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-a7b6d88b-e0d7-4661-b00d-8d6156b857c3 tempest-VolumesSnapshotListTestJSON-934178089 None] Created volume successfully. Feb 27 02:07:24 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8745153b-9e54-4e67-9b39-4cf317257e5f tempest-VolumeDependencyTests-1347283663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61" returned: 0 in 0.642s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8745153b-9e54-4e67-9b39-4cf317257e5f tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:24 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61 Feb 27 02:07:24 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:24 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ded3fcae-9db1-4624-8b66-675a5ed73953 1073741824" returned: 0 in 0.680s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ded3fcae-9db1-4624-8b66-675a5ed73953 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:24 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ded3fcae-9db1-4624-8b66-675a5ed73953 Feb 27 02:07:24 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-07db2bd5-8dd6-49d2-9649-12fff04aa1d4 tempest-VolumesSnapshotListTestJSON-934178089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:24 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8745153b-9e54-4e67-9b39-4cf317257e5f tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-38a277a2-367f-4063-bd8f-c38bc2e87d61" returned: 0 in 0.662s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:24 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8745153b-9e54-4e67-9b39-4cf317257e5f tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-quobyte-38a277a2-367f-4063-bd8f-c38bc2e87d61" released by "delete_volume" :: held 1.352s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:24 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-8745153b-9e54-4e67-9b39-4cf317257e5f tempest-VolumeDependencyTests-1347283663 None] Created reservations ['385f0650-632b-4b6a-a8a4-502ce476f642', '8f34bcae-0002-478b-8a29-e9a5ba95b1be', 'd114e22c-91fb-477e-b2f4-66c80c69b21d', '2e479a19-8275-49fc-9a90-40077dcdf16d'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8745153b-9e54-4e67-9b39-4cf317257e5f tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8745153b-9e54-4e67-9b39-4cf317257e5f tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:24 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8745153b-9e54-4e67-9b39-4cf317257e5f tempest-VolumeDependencyTests-1347283663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:24 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8745153b-9e54-4e67-9b39-4cf317257e5f tempest-VolumeDependencyTests-1347283663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8745153b-9e54-4e67-9b39-4cf317257e5f tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8745153b-9e54-4e67-9b39-4cf317257e5f tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:24 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:07:24 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:24 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ded3fcae-9db1-4624-8b66-675a5ed73953" returned: 0 in 0.493s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:24 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-07db2bd5-8dd6-49d2-9649-12fff04aa1d4 tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.347s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:24 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-07db2bd5-8dd6-49d2-9649-12fff04aa1d4 tempest-VolumesSnapshotListTestJSON-934178089 None] Creating offline snapshot 4396e4c8-d9d4-45d5-bdad-40ed7c94caff of volume 17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62808bb5-4ee7-43fd-a0ed-310188cb3e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ded3fcae-9db1-4624-8b66-675a5ed73953', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8e4f00-767d-4273-8f57-3db3a5ac019e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[498007fa-f342-41e5-a271-45a91cef667a]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07db2bd5-8dd6-49d2-9649-12fff04aa1d4 tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:25 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Volume volume-ded3fcae-9db1-4624-8b66-675a5ed73953 (ded3fcae-9db1-4624-8b66-675a5ed73953): created successfully Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8e4f00-767d-4273-8f57-3db3a5ac019e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Flow 'volume_create_manager' (ae917df3-0ba0-4bb7-9c3a-9d6728c38740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:25 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-d51cbca4-2996-4e46-9f49-318f44a8d0ba tempest-VolumesListTestJSON-678901916 None] Created volume successfully. Feb 27 02:07:25 devstack sudo[88454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 Feb 27 02:07:25 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:25 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8745153b-9e54-4e67-9b39-4cf317257e5f tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.523s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-8745153b-9e54-4e67-9b39-4cf317257e5f tempest-VolumeDependencyTests-1347283663 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:25 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-8745153b-9e54-4e67-9b39-4cf317257e5f tempest-VolumeDependencyTests-1347283663 None] Deleted volume successfully. Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8745153b-9e54-4e67-9b39-4cf317257e5f tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-38a277a2-367f-4063-bd8f-c38bc2e87d61-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:25 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07db2bd5-8dd6-49d2-9649-12fff04aa1d4 tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42" returned: 0 in 0.642s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07db2bd5-8dd6-49d2-9649-12fff04aa1d4 tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:25 devstack sudo[88460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff 1G Feb 27 02:07:25 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Flow 'volume_create_manager' (b323c91d-aa3d-4d19-a85d-a699919d94d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebb65ab-5bfc-49c1-835b-5fe4b74e4913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebb65ab-5bfc-49c1-835b-5fe4b74e4913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-957696266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f00937-8d7a-4dae-97c3-0b3c70b0328a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3931fd25df7b4207a0093d5fab43bb1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:26Z,use_quota=True,user_id='28d1dd94e86b449092bf87b598a7c1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f04dc2-3dc8-4e0d-a371-f98c56ff1317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f04dc2-3dc8-4e0d-a371-f98c56ff1317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc4c644-2e9f-417e-9868-51e403faabea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc4c644-2e9f-417e-9868-51e403faabea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30f00937-8d7a-4dae-97c3-0b3c70b0328a', 'volume_name': 'volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902a4aae-5975-4fe3-a416-8e736c16a512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902a4aae-5975-4fe3-a416-8e736c16a512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93143d20-bca6-4778-ac6f-528fcd6d5a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:25 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Volume 30f00937-8d7a-4dae-97c3-0b3c70b0328a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a', 'volume_size': 1} Feb 27 02:07:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:26 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07db2bd5-8dd6-49d2-9649-12fff04aa1d4 tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff 1G" returned: 0 in 0.615s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07db2bd5-8dd6-49d2-9649-12fff04aa1d4 tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:26 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff Feb 27 02:07:26 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:26 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Flow 'volume_create_manager' (938d4678-58d8-4a79-aff6-38e93f501fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470cd094-8a4d-4412-a4aa-833c05456766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470cd094-8a4d-4412-a4aa-833c05456766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-439270115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=476aa98e-09b9-4623-9675-2e4de5d24679,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d41029d7cf3413191a8bb31b19a24bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:26Z,use_quota=True,user_id='1d5e68d6dc144ad5ab71e82c055cb8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4561d2c8-0b1f-40de-955f-8590d54de37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4561d2c8-0b1f-40de-955f-8590d54de37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4dcaff3-7d7a-4f34-8c23-bd559e403cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4dcaff3-7d7a-4f34-8c23-bd559e403cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '476aa98e-09b9-4623-9675-2e4de5d24679', 'volume_name': 'volume-476aa98e-09b9-4623-9675-2e4de5d24679', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65931e9-89c9-4299-ae90-0160428843e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65931e9-89c9-4299-ae90-0160428843e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f016a7-5d4d-4fb9-9745-33faf60aa40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:26 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Volume 476aa98e-09b9-4623-9675-2e4de5d24679: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-476aa98e-09b9-4623-9675-2e4de5d24679', 'volume_size': 1} Feb 27 02:07:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:26 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07db2bd5-8dd6-49d2-9649-12fff04aa1d4 tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff" returned: 0 in 0.537s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:26 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-07db2bd5-8dd6-49d2-9649-12fff04aa1d4 tempest-VolumesSnapshotListTestJSON-934178089 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff is being set with open permissions: ugo+rw Feb 27 02:07:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07db2bd5-8dd6-49d2-9649-12fff04aa1d4 tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:26 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff Feb 27 02:07:26 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:27 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07db2bd5-8dd6-49d2-9649-12fff04aa1d4 tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff" returned: 0 in 0.499s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07db2bd5-8dd6-49d2-9649-12fff04aa1d4 tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:27 devstack sudo[88473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.info Feb 27 02:07:27 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:27 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07db2bd5-8dd6-49d2-9649-12fff04aa1d4 tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.info" returned: 0 in 0.526s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:27 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-07db2bd5-8dd6-49d2-9649-12fff04aa1d4 tempest-VolumesSnapshotListTestJSON-934178089 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.info is being set with open permissions: ugo+rw Feb 27 02:07:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07db2bd5-8dd6-49d2-9649-12fff04aa1d4 tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:27 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.info Feb 27 02:07:27 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:28 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07db2bd5-8dd6-49d2-9649-12fff04aa1d4 tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.info" returned: 0 in 0.460s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-07db2bd5-8dd6-49d2-9649-12fff04aa1d4 tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.360s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.486s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:28 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-957696266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f00937-8d7a-4dae-97c3-0b3c70b0328a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3931fd25df7b4207a0093d5fab43bb1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:26Z,use_quota=True,user_id='28d1dd94e86b449092bf87b598a7c1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:28 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Creating volume 30f00937-8d7a-4dae-97c3-0b3c70b0328a {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:28 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:28 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:28 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:28 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:07:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:28 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a 1073741824 Feb 27 02:07:28 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:28 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-07db2bd5-8dd6-49d2-9649-12fff04aa1d4 tempest-VolumesSnapshotListTestJSON-934178089 None] Create snapshot completed successfully Feb 27 02:07:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bb15fb55-a13f-41f1-ba66-66505ff8602a tempest-VolumesSnapshotListTestJSON-934178089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:28 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a 1073741824" returned: 0 in 0.604s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:28 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a Feb 27 02:07:29 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:29 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a" returned: 0 in 0.518s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:29 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.961s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:29 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-439270115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=476aa98e-09b9-4623-9675-2e4de5d24679,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d41029d7cf3413191a8bb31b19a24bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:26Z,use_quota=True,user_id='1d5e68d6dc144ad5ab71e82c055cb8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:29 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Creating volume 476aa98e-09b9-4623-9675-2e4de5d24679 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:29 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:29 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:29 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:29 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:07:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-476aa98e-09b9-4623-9675-2e4de5d24679 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93143d20-bca6-4778-ac6f-528fcd6d5a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:29 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-476aa98e-09b9-4623-9675-2e4de5d24679 1073741824 Feb 27 02:07:29 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9184ecd0-f1b3-4747-9ec2-11cefc6801fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:29 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Volume volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a (30f00937-8d7a-4dae-97c3-0b3c70b0328a): created successfully Feb 27 02:07:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9184ecd0-f1b3-4747-9ec2-11cefc6801fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Flow 'volume_create_manager' (b323c91d-aa3d-4d19-a85d-a699919d94d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:29 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-f5b344af-0ae0-4f2a-98a5-1fdbee3f9d5a tempest-VolumeDependencyTests-1347283663 None] Created volume successfully. Feb 27 02:07:30 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-476aa98e-09b9-4623-9675-2e4de5d24679 1073741824" returned: 0 in 0.658s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-476aa98e-09b9-4623-9675-2e4de5d24679 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:30 devstack sudo[88493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-476aa98e-09b9-4623-9675-2e4de5d24679 Feb 27 02:07:30 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Flow 'volume_create_manager' (e5c4fb0c-59b7-407b-b192-caf237dd2903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e17c317-2217-4dda-bc16-25b5402211ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e17c317-2217-4dda-bc16-25b5402211ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1542925568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=169a7a86-a413-4ea2-92fe-b0e119de223c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3931fd25df7b4207a0093d5fab43bb1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=30f00937-8d7a-4dae-97c3-0b3c70b0328a,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:30Z,use_quota=True,user_id='28d1dd94e86b449092bf87b598a7c1a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384c6c3a-8ffe-4d33-91a0-03bfeabbbdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384c6c3a-8ffe-4d33-91a0-03bfeabbbdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e7822b9-5701-41ec-a8d1-5118ecaa544f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e7822b9-5701-41ec-a8d1-5118ecaa544f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '169a7a86-a413-4ea2-92fe-b0e119de223c', 'volume_name': 'volume-169a7a86-a413-4ea2-92fe-b0e119de223c', 'volume_size': 1, 'source_volid': '30f00937-8d7a-4dae-97c3-0b3c70b0328a', 'source_volstatus': 'available'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd7fd17-3127-4f21-8a29-a88d2f8fcb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd7fd17-3127-4f21-8a29-a88d2f8fcb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde0ac89-291a-4dd3-9ce4-338be83e3956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:30 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Volume 169a7a86-a413-4ea2-92fe-b0e119de223c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-169a7a86-a413-4ea2-92fe-b0e119de223c', 'volume_size': 1, 'source_volid': '30f00937-8d7a-4dae-97c3-0b3c70b0328a', 'source_volstatus': 'available'} Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:30 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-476aa98e-09b9-4623-9675-2e4de5d24679" returned: 0 in 0.481s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bb15fb55-a13f-41f1-ba66-66505ff8602a tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.770s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-bb15fb55-a13f-41f1-ba66-66505ff8602a tempest-VolumesSnapshotListTestJSON-934178089 None] Creating offline snapshot ec6df714-6187-45bb-b2d0-f1b9d5d52d67 of volume 17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7f016a7-5d4d-4fb9-9745-33faf60aa40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-476aa98e-09b9-4623-9675-2e4de5d24679', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066e4313-996b-45eb-90fb-0ff9888d28f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ea1949-d37d-426d-b658-77560925d613]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bb15fb55-a13f-41f1-ba66-66505ff8602a tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:30 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Volume volume-476aa98e-09b9-4623-9675-2e4de5d24679 (476aa98e-09b9-4623-9675-2e4de5d24679): created successfully Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066e4313-996b-45eb-90fb-0ff9888d28f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:30 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Flow 'volume_create_manager' (938d4678-58d8-4a79-aff6-38e93f501fca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:30 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-445451d5-6c6c-4aff-98ee-4958ddd9a6fd tempest-VolumesListTestJSON-678901916 None] Created volume successfully. Feb 27 02:07:30 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff Feb 27 02:07:30 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:31 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bb15fb55-a13f-41f1-ba66-66505ff8602a tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff" returned: 0 in 0.628s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:31 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-bb15fb55-a13f-41f1-ba66-66505ff8602a tempest-VolumesSnapshotListTestJSON-934178089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bb15fb55-a13f-41f1-ba66-66505ff8602a tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:31 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 1G Feb 27 02:07:31 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:31 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bb15fb55-a13f-41f1-ba66-66505ff8602a tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 1G" returned: 0 in 0.587s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bb15fb55-a13f-41f1-ba66-66505ff8602a tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:31 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 Feb 27 02:07:31 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:32 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bb15fb55-a13f-41f1-ba66-66505ff8602a tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67" returned: 0 in 0.514s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:32 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-bb15fb55-a13f-41f1-ba66-66505ff8602a tempest-VolumesSnapshotListTestJSON-934178089 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 is being set with open permissions: ugo+rw Feb 27 02:07:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bb15fb55-a13f-41f1-ba66-66505ff8602a tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:32 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 Feb 27 02:07:32 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:32 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bb15fb55-a13f-41f1-ba66-66505ff8602a tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67" returned: 0 in 0.527s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bb15fb55-a13f-41f1-ba66-66505ff8602a tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.337s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.505s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:33 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Cloning volume 30f00937-8d7a-4dae-97c3-0b3c70b0328a to volume 169a7a86-a413-4ea2-92fe-b0e119de223c Feb 27 02:07:33 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-bb15fb55-a13f-41f1-ba66-66505ff8602a tempest-VolumesSnapshotListTestJSON-934178089 None] Create snapshot completed successfully Feb 27 02:07:33 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Creating offline snapshot 83e6c807-90b6-46b2-9c80-efa5b45f3937 of volume 30f00937-8d7a-4dae-97c3-0b3c70b0328a {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:33 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[66501a3e-6b77-4e7f-a0e4-28e1e6ae4962]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:33 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a Feb 27 02:07:33 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:33 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a" returned: 0 in 0.720s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:33 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937 1G Feb 27 02:07:33 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:34 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0ece8cf5-889d-4dd2-98fd-d5cd03e93a7d tempest-VolumesListTestJSON-678901916 None] Acquiring lock "cinder-476aa98e-09b9-4623-9675-2e4de5d24679-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:34 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0ece8cf5-889d-4dd2-98fd-d5cd03e93a7d tempest-VolumesListTestJSON-678901916 None] Lock "cinder-476aa98e-09b9-4623-9675-2e4de5d24679-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:34 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0ece8cf5-889d-4dd2-98fd-d5cd03e93a7d tempest-VolumesListTestJSON-678901916 None] Acquiring lock "cinder-quobyte-476aa98e-09b9-4623-9675-2e4de5d24679" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:34 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0ece8cf5-889d-4dd2-98fd-d5cd03e93a7d tempest-VolumesListTestJSON-678901916 None] Lock "cinder-quobyte-476aa98e-09b9-4623-9675-2e4de5d24679" acquired by "delete_volume" :: waited 0.021s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:34 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8a6e52-c088-4627-8f78-5b22929aa0bf]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0ece8cf5-889d-4dd2-98fd-d5cd03e93a7d tempest-VolumesListTestJSON-678901916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-476aa98e-09b9-4623-9675-2e4de5d24679 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f5cb5b82-5cb4-4686-9956-0d4133a624f8 tempest-VolumesSnapshotListTestJSON-934178089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:34 devstack sudo[88521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-476aa98e-09b9-4623-9675-2e4de5d24679 Feb 27 02:07:34 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:34 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937 1G" returned: 0 in 0.780s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:34 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937 Feb 27 02:07:34 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:34 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0ece8cf5-889d-4dd2-98fd-d5cd03e93a7d tempest-VolumesListTestJSON-678901916 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-476aa98e-09b9-4623-9675-2e4de5d24679" returned: 0 in 0.618s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0ece8cf5-889d-4dd2-98fd-d5cd03e93a7d tempest-VolumesListTestJSON-678901916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-476aa98e-09b9-4623-9675-2e4de5d24679 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:34 devstack sudo[88531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-476aa98e-09b9-4623-9675-2e4de5d24679 Feb 27 02:07:34 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:35 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937" returned: 0 in 0.558s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:35 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937 is being set with open permissions: ugo+rw Feb 27 02:07:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:35 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937 Feb 27 02:07:35 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:35 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0ece8cf5-889d-4dd2-98fd-d5cd03e93a7d tempest-VolumesListTestJSON-678901916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-476aa98e-09b9-4623-9675-2e4de5d24679" returned: 0 in 0.534s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:35 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0ece8cf5-889d-4dd2-98fd-d5cd03e93a7d tempest-VolumesListTestJSON-678901916 None] Lock "cinder-quobyte-476aa98e-09b9-4623-9675-2e4de5d24679" released by "delete_volume" :: held 1.188s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:35 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-0ece8cf5-889d-4dd2-98fd-d5cd03e93a7d tempest-VolumesListTestJSON-678901916 None] Created reservations ['410e73e0-4fb5-4aae-b6a5-ca0d6cd204ef', 'd1c78461-394d-447b-92f1-dff0e1b73d95', '4ed87e3d-2e0c-476e-9056-444e20d7d87b', 'b8026b2b-60c2-47c7-af7a-c804ea6c80f4'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0ece8cf5-889d-4dd2-98fd-d5cd03e93a7d tempest-VolumesListTestJSON-678901916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0ece8cf5-889d-4dd2-98fd-d5cd03e93a7d tempest-VolumesListTestJSON-678901916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:35 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0ece8cf5-889d-4dd2-98fd-d5cd03e93a7d tempest-VolumesListTestJSON-678901916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:35 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0ece8cf5-889d-4dd2-98fd-d5cd03e93a7d tempest-VolumesListTestJSON-678901916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0ece8cf5-889d-4dd2-98fd-d5cd03e93a7d tempest-VolumesListTestJSON-678901916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0ece8cf5-889d-4dd2-98fd-d5cd03e93a7d tempest-VolumesListTestJSON-678901916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:35 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:07:35 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:35 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937" returned: 0 in 0.529s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:35 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.info Feb 27 02:07:35 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:36 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0ece8cf5-889d-4dd2-98fd-d5cd03e93a7d tempest-VolumesListTestJSON-678901916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.505s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-0ece8cf5-889d-4dd2-98fd-d5cd03e93a7d tempest-VolumesListTestJSON-678901916 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:36 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-0ece8cf5-889d-4dd2-98fd-d5cd03e93a7d tempest-VolumesListTestJSON-678901916 None] Deleted volume successfully. Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0ece8cf5-889d-4dd2-98fd-d5cd03e93a7d tempest-VolumesListTestJSON-678901916 None] Lock "cinder-476aa98e-09b9-4623-9675-2e4de5d24679-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:36 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.info" returned: 0 in 0.504s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:36 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.info is being set with open permissions: ugo+rw Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:36 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.info Feb 27 02:07:36 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-00c8909c-87bd-41c7-a2dc-f4ed285a1fe1 tempest-VolumesListTestJSON-678901916 None] Acquiring lock "cinder-ded3fcae-9db1-4624-8b66-675a5ed73953-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-00c8909c-87bd-41c7-a2dc-f4ed285a1fe1 tempest-VolumesListTestJSON-678901916 None] Lock "cinder-ded3fcae-9db1-4624-8b66-675a5ed73953-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-00c8909c-87bd-41c7-a2dc-f4ed285a1fe1 tempest-VolumesListTestJSON-678901916 None] Acquiring lock "cinder-quobyte-ded3fcae-9db1-4624-8b66-675a5ed73953" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-00c8909c-87bd-41c7-a2dc-f4ed285a1fe1 tempest-VolumesListTestJSON-678901916 None] Lock "cinder-quobyte-ded3fcae-9db1-4624-8b66-675a5ed73953" acquired by "delete_volume" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5616e1f1-8d04-4cf8-98aa-ea424aea8920]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-00c8909c-87bd-41c7-a2dc-f4ed285a1fe1 tempest-VolumesListTestJSON-678901916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ded3fcae-9db1-4624-8b66-675a5ed73953 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:36 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ded3fcae-9db1-4624-8b66-675a5ed73953 Feb 27 02:07:36 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:36 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.info" returned: 0 in 0.557s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "cinder-quobyte-169a7a86-a413-4ea2-92fe-b0e119de223c" by "_copy_volume_from_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-quobyte-169a7a86-a413-4ea2-92fe-b0e119de223c" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] snapshot: 83e6c807-90b6-46b2-9c80-efa5b45f3937, volume: 169a7a86-a413-4ea2-92fe-b0e119de223c, {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d7edb2-6f1b-40d0-bdbb-4d0ed92bfe58]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:36 devstack sudo[88554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937 Feb 27 02:07:36 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:36 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-00c8909c-87bd-41c7-a2dc-f4ed285a1fe1 tempest-VolumesListTestJSON-678901916 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ded3fcae-9db1-4624-8b66-675a5ed73953" returned: 0 in 0.537s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-00c8909c-87bd-41c7-a2dc-f4ed285a1fe1 tempest-VolumesListTestJSON-678901916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ded3fcae-9db1-4624-8b66-675a5ed73953 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:36 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ded3fcae-9db1-4624-8b66-675a5ed73953 Feb 27 02:07:36 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:37 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937" returned: 0 in 0.526s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:37 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:37 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] will copy from snapshot at /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:07:37 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Creating direct copy from snapshot {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:07:37 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c829961-198e-44c7-ac62-04ab36ad7ece]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:37 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-00c8909c-87bd-41c7-a2dc-f4ed285a1fe1 tempest-VolumesListTestJSON-678901916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ded3fcae-9db1-4624-8b66-675a5ed73953" returned: 0 in 0.459s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:37 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-00c8909c-87bd-41c7-a2dc-f4ed285a1fe1 tempest-VolumesListTestJSON-678901916 None] Lock "cinder-quobyte-ded3fcae-9db1-4624-8b66-675a5ed73953" released by "delete_volume" :: held 1.028s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:37 devstack sudo[88565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a Feb 27 02:07:37 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:37 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-00c8909c-87bd-41c7-a2dc-f4ed285a1fe1 tempest-VolumesListTestJSON-678901916 None] Created reservations ['012130b4-e105-499b-a0f1-60a341819a10', 'fe096f46-be03-41e2-9bbf-c0df93769e8a', '56940f93-8c90-471b-9830-43dbf42a013e', '536edd47-5c09-431c-9eaf-4626ae1d4825'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-00c8909c-87bd-41c7-a2dc-f4ed285a1fe1 tempest-VolumesListTestJSON-678901916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-00c8909c-87bd-41c7-a2dc-f4ed285a1fe1 tempest-VolumesListTestJSON-678901916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:37 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-00c8909c-87bd-41c7-a2dc-f4ed285a1fe1 tempest-VolumesListTestJSON-678901916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:37 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-00c8909c-87bd-41c7-a2dc-f4ed285a1fe1 tempest-VolumesListTestJSON-678901916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-00c8909c-87bd-41c7-a2dc-f4ed285a1fe1 tempest-VolumesListTestJSON-678901916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-00c8909c-87bd-41c7-a2dc-f4ed285a1fe1 tempest-VolumesListTestJSON-678901916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:37 devstack sudo[88567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:07:37 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:37 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a" returned: 0 in 0.556s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:37 devstack cinder-volume[82683]: DEBUG cinder.utils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Path /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-169a7a86-a413-4ea2-92fe-b0e119de223c not found in is_blk_device check {{(pid=82683) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:07:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-169a7a86-a413-4ea2-92fe-b0e119de223c {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:37 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-169a7a86-a413-4ea2-92fe-b0e119de223c Feb 27 02:07:37 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:37 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-00c8909c-87bd-41c7-a2dc-f4ed285a1fe1 tempest-VolumesListTestJSON-678901916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.471s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:37 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-00c8909c-87bd-41c7-a2dc-f4ed285a1fe1 tempest-VolumesListTestJSON-678901916 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:38 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-00c8909c-87bd-41c7-a2dc-f4ed285a1fe1 tempest-VolumesListTestJSON-678901916 None] Deleted volume successfully. Feb 27 02:07:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-00c8909c-87bd-41c7-a2dc-f4ed285a1fe1 tempest-VolumesListTestJSON-678901916 None] Lock "cinder-ded3fcae-9db1-4624-8b66-675a5ed73953-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9c506660-08cf-4ddd-8f45-5222d151a390 tempest-VolumesListTestJSON-678901916 None] Acquiring lock "cinder-02f2aa9b-a34d-4bfb-b620-30805b729777-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9c506660-08cf-4ddd-8f45-5222d151a390 tempest-VolumesListTestJSON-678901916 None] Lock "cinder-02f2aa9b-a34d-4bfb-b620-30805b729777-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9c506660-08cf-4ddd-8f45-5222d151a390 tempest-VolumesListTestJSON-678901916 None] Acquiring lock "cinder-quobyte-02f2aa9b-a34d-4bfb-b620-30805b729777" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9c506660-08cf-4ddd-8f45-5222d151a390 tempest-VolumesListTestJSON-678901916 None] Lock "cinder-quobyte-02f2aa9b-a34d-4bfb-b620-30805b729777" acquired by "delete_volume" :: waited 0.031s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:39 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc46782-9738-49d5-88a9-a3f51b3b1179]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9c506660-08cf-4ddd-8f45-5222d151a390 tempest-VolumesListTestJSON-678901916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-02f2aa9b-a34d-4bfb-b620-30805b729777 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:39 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-02f2aa9b-a34d-4bfb-b620-30805b729777 Feb 27 02:07:39 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:40 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9c506660-08cf-4ddd-8f45-5222d151a390 tempest-VolumesListTestJSON-678901916 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-02f2aa9b-a34d-4bfb-b620-30805b729777" returned: 0 in 1.622s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9c506660-08cf-4ddd-8f45-5222d151a390 tempest-VolumesListTestJSON-678901916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-02f2aa9b-a34d-4bfb-b620-30805b729777 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:40 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-169a7a86-a413-4ea2-92fe-b0e119de223c" returned: 0 in 2.715s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:40 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f56470-cb8f-4ea4-aac4-686afbc836db]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:40 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-02f2aa9b-a34d-4bfb-b620-30805b729777 Feb 27 02:07:40 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:40 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a Feb 27 02:07:40 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:41 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9c506660-08cf-4ddd-8f45-5222d151a390 tempest-VolumesListTestJSON-678901916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-02f2aa9b-a34d-4bfb-b620-30805b729777" returned: 0 in 0.581s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9c506660-08cf-4ddd-8f45-5222d151a390 tempest-VolumesListTestJSON-678901916 None] Lock "cinder-quobyte-02f2aa9b-a34d-4bfb-b620-30805b729777" released by "delete_volume" :: held 2.255s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:41 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-9c506660-08cf-4ddd-8f45-5222d151a390 tempest-VolumesListTestJSON-678901916 None] Created reservations ['24022395-cdcf-4c12-929a-3fd9ecca06e8', '8641a6d8-c4a8-4587-a9a9-c20625f42e94', 'f363e5ee-7ebe-4b7e-96c4-48f7d206ddd3', '83544e68-2761-4270-b8e7-23e5e846f4fa'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9c506660-08cf-4ddd-8f45-5222d151a390 tempest-VolumesListTestJSON-678901916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9c506660-08cf-4ddd-8f45-5222d151a390 tempest-VolumesListTestJSON-678901916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:41 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-9c506660-08cf-4ddd-8f45-5222d151a390 tempest-VolumesListTestJSON-678901916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:41 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-9c506660-08cf-4ddd-8f45-5222d151a390 tempest-VolumesListTestJSON-678901916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9c506660-08cf-4ddd-8f45-5222d151a390 tempest-VolumesListTestJSON-678901916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9c506660-08cf-4ddd-8f45-5222d151a390 tempest-VolumesListTestJSON-678901916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:41 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:07:41 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:41 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a" returned: 0 in 0.834s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:41 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Image conversion details: src /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a, size 1024.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-169a7a86-a413-4ea2-92fe-b0e119de223c {{(pid=82683) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:07:41 devstack cinder-volume[82683]: INFO cinder.image.image_utils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Converted 1024.00 MB image at 376.73 MB/s Feb 27 02:07:41 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-169a7a86-a413-4ea2-92fe-b0e119de223c is being set with open permissions: ugo+rw Feb 27 02:07:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-169a7a86-a413-4ea2-92fe-b0e119de223c {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:41 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-169a7a86-a413-4ea2-92fe-b0e119de223c Feb 27 02:07:41 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:41 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9c506660-08cf-4ddd-8f45-5222d151a390 tempest-VolumesListTestJSON-678901916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.583s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:41 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-9c506660-08cf-4ddd-8f45-5222d151a390 tempest-VolumesListTestJSON-678901916 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:41 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-9c506660-08cf-4ddd-8f45-5222d151a390 tempest-VolumesListTestJSON-678901916 None] Deleted volume successfully. Feb 27 02:07:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9c506660-08cf-4ddd-8f45-5222d151a390 tempest-VolumesListTestJSON-678901916 None] Lock "cinder-02f2aa9b-a34d-4bfb-b620-30805b729777-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:42 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-169a7a86-a413-4ea2-92fe-b0e119de223c" returned: 0 in 0.519s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:42 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-quobyte-169a7a86-a413-4ea2-92fe-b0e119de223c" released by "_copy_volume_from_snapshot" :: held 5.213s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:42 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "cinder-quobyte-83e6c807-90b6-46b2-9c80-efa5b45f3937" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:42 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-quobyte-83e6c807-90b6-46b2-9c80-efa5b45f3937" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:42 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Deleting offline snapshot 83e6c807-90b6-46b2-9c80-efa5b45f3937 of volume 30f00937-8d7a-4dae-97c3-0b3c70b0328a {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:42 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] snapshot_file for this snap is: volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:42 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dc0355-68e1-4fbe-97d5-164099c5677c]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:42 devstack sudo[88622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937 Feb 27 02:07:42 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:42 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937" returned: 0 in 0.643s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:42 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:42 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[23557a49-aafd-43ea-a499-f1cb1906b5ed]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:42 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a Feb 27 02:07:42 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:43 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a" returned: 0 in 0.612s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:43 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937 Feb 27 02:07:43 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:43 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937" returned: 0 in 0.594s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:43 devstack sudo[88638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937 Feb 27 02:07:43 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:44 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a.83e6c807-90b6-46b2-9c80-efa5b45f3937" returned: 0 in 0.484s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-quobyte-83e6c807-90b6-46b2-9c80-efa5b45f3937" released by "_delete_snapshot" :: held 2.389s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.440s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f5cb5b82-5cb4-4686-9956-0d4133a624f8 tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.169s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde0ac89-291a-4dd3-9ce4-338be83e3956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-169a7a86-a413-4ea2-92fe-b0e119de223c', 'volume_size': 1, 'source_volid': '30f00937-8d7a-4dae-97c3-0b3c70b0328a', 'source_volstatus': 'available'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1149d8b1-c4a3-4a61-99e0-873fd56f8db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-f5cb5b82-5cb4-4686-9956-0d4133a624f8 tempest-VolumesSnapshotListTestJSON-934178089 None] Creating offline snapshot e0e9b7cc-add1-4cc9-a346-c073883051e5 of volume 17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:07:44 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Volume volume-169a7a86-a413-4ea2-92fe-b0e119de223c (169a7a86-a413-4ea2-92fe-b0e119de223c): created successfully Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1149d8b1-c4a3-4a61-99e0-873fd56f8db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Flow 'volume_create_manager' (e5c4fb0c-59b7-407b-b192-caf237dd2903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[985e5d07-0a13-4b0c-9924-e5266645eb8d]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f5cb5b82-5cb4-4686-9956-0d4133a624f8 tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:44 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-bcc316a6-7b6d-4f14-854d-9f5d005a361d tempest-VolumeDependencyTests-1347283663 None] Created volume successfully. Feb 27 02:07:44 devstack sudo[88641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 Feb 27 02:07:44 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Flow 'volume_create_manager' (2ff31b9d-59f8-4313-8f8e-06b081ab8c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82dcee7f-1f33-4480-94c1-de2273fc694d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82dcee7f-1f33-4480-94c1-de2273fc694d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1636584024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9451ec-b164-49ce-8bdd-7d493c30971b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e1db33e7524cfc9980387041917de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:45Z,use_quota=True,user_id='b53c4289cb914ed2856850dafbfb69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d84fb4-155d-43be-b047-cf7dde414172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d84fb4-155d-43be-b047-cf7dde414172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22b6b89-2fd1-4145-816a-b234448d58eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22b6b89-2fd1-4145-816a-b234448d58eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed9451ec-b164-49ce-8bdd-7d493c30971b', 'volume_name': 'volume-ed9451ec-b164-49ce-8bdd-7d493c30971b', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7142453-0c25-460e-8c89-6b9670660b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7142453-0c25-460e-8c89-6b9670660b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e739cf-cdaa-411e-b60c-88b4a49a7434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:44 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Volume ed9451ec-b164-49ce-8bdd-7d493c30971b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed9451ec-b164-49ce-8bdd-7d493c30971b', 'volume_size': 1} Feb 27 02:07:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:45 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f5cb5b82-5cb4-4686-9956-0d4133a624f8 tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67" returned: 0 in 0.559s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-f5cb5b82-5cb4-4686-9956-0d4133a624f8 tempest-VolumesSnapshotListTestJSON-934178089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f5cb5b82-5cb4-4686-9956-0d4133a624f8 tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.e0e9b7cc-add1-4cc9-a346-c073883051e5 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:45 devstack sudo[88646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.e0e9b7cc-add1-4cc9-a346-c073883051e5 1G Feb 27 02:07:45 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:45 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-27544b22-4af8-4fda-8b2c-a6bb8d879c80 tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "cinder-30f00937-8d7a-4dae-97c3-0b3c70b0328a-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:45 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-27544b22-4af8-4fda-8b2c-a6bb8d879c80 tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-30f00937-8d7a-4dae-97c3-0b3c70b0328a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:45 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-27544b22-4af8-4fda-8b2c-a6bb8d879c80 tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "cinder-quobyte-30f00937-8d7a-4dae-97c3-0b3c70b0328a" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:45 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-27544b22-4af8-4fda-8b2c-a6bb8d879c80 tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-quobyte-30f00937-8d7a-4dae-97c3-0b3c70b0328a" acquired by "delete_volume" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:45 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f09da2-45b1-4f77-8f5d-071df0c391d7]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-27544b22-4af8-4fda-8b2c-a6bb8d879c80 tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:45 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a Feb 27 02:07:45 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:45 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f5cb5b82-5cb4-4686-9956-0d4133a624f8 tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.e0e9b7cc-add1-4cc9-a346-c073883051e5 1G" returned: 0 in 0.598s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f5cb5b82-5cb4-4686-9956-0d4133a624f8 tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.e0e9b7cc-add1-4cc9-a346-c073883051e5 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:45 devstack sudo[88653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.e0e9b7cc-add1-4cc9-a346-c073883051e5 Feb 27 02:07:45 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:46 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-27544b22-4af8-4fda-8b2c-a6bb8d879c80 tempest-VolumeDependencyTests-1347283663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a" returned: 0 in 0.556s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-27544b22-4af8-4fda-8b2c-a6bb8d879c80 tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:46 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a Feb 27 02:07:46 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:46 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f5cb5b82-5cb4-4686-9956-0d4133a624f8 tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.e0e9b7cc-add1-4cc9-a346-c073883051e5" returned: 0 in 0.489s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:46 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-f5cb5b82-5cb4-4686-9956-0d4133a624f8 tempest-VolumesSnapshotListTestJSON-934178089 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.e0e9b7cc-add1-4cc9-a346-c073883051e5 is being set with open permissions: ugo+rw Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f5cb5b82-5cb4-4686-9956-0d4133a624f8 tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.e0e9b7cc-add1-4cc9-a346-c073883051e5 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:46 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.e0e9b7cc-add1-4cc9-a346-c073883051e5 Feb 27 02:07:46 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:46 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-27544b22-4af8-4fda-8b2c-a6bb8d879c80 tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-30f00937-8d7a-4dae-97c3-0b3c70b0328a" returned: 0 in 0.487s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-27544b22-4af8-4fda-8b2c-a6bb8d879c80 tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-quobyte-30f00937-8d7a-4dae-97c3-0b3c70b0328a" released by "delete_volume" :: held 1.076s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:46 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f5cb5b82-5cb4-4686-9956-0d4133a624f8 tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.e0e9b7cc-add1-4cc9-a346-c073883051e5" returned: 0 in 0.472s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f5cb5b82-5cb4-4686-9956-0d4133a624f8 tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.221s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.945s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1636584024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9451ec-b164-49ce-8bdd-7d493c30971b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e1db33e7524cfc9980387041917de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:45Z,use_quota=True,user_id='b53c4289cb914ed2856850dafbfb69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Creating volume ed9451ec-b164-49ce-8bdd-7d493c30971b {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:46 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ed9451ec-b164-49ce-8bdd-7d493c30971b 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-27544b22-4af8-4fda-8b2c-a6bb8d879c80 tempest-VolumeDependencyTests-1347283663 None] Created reservations ['9f7e3ed3-3c31-430d-b77a-9aae77b03714', '3ac78bde-89fb-40c5-9c41-081492e0c8a7', '7ebf3d6f-5fe9-4425-9a80-e4c36cf32aea', '08ab9db8-8401-46d5-aad2-9a71eeac67a8'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:46 devstack sudo[88670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ed9451ec-b164-49ce-8bdd-7d493c30971b 1073741824 Feb 27 02:07:46 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:46 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-f5cb5b82-5cb4-4686-9956-0d4133a624f8 tempest-VolumesSnapshotListTestJSON-934178089 None] Create snapshot completed successfully Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-27544b22-4af8-4fda-8b2c-a6bb8d879c80 tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-27544b22-4af8-4fda-8b2c-a6bb8d879c80 tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-27544b22-4af8-4fda-8b2c-a6bb8d879c80 tempest-VolumeDependencyTests-1347283663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-27544b22-4af8-4fda-8b2c-a6bb8d879c80 tempest-VolumeDependencyTests-1347283663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-27544b22-4af8-4fda-8b2c-a6bb8d879c80 tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-27544b22-4af8-4fda-8b2c-a6bb8d879c80 tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:46 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:07:46 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:47 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-27544b22-4af8-4fda-8b2c-a6bb8d879c80 tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.457s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:47 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-27544b22-4af8-4fda-8b2c-a6bb8d879c80 tempest-VolumeDependencyTests-1347283663 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:47 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ed9451ec-b164-49ce-8bdd-7d493c30971b 1073741824" returned: 0 in 0.530s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:47 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-27544b22-4af8-4fda-8b2c-a6bb8d879c80 tempest-VolumeDependencyTests-1347283663 None] Deleted volume successfully. Feb 27 02:07:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-27544b22-4af8-4fda-8b2c-a6bb8d879c80 tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-30f00937-8d7a-4dae-97c3-0b3c70b0328a-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ed9451ec-b164-49ce-8bdd-7d493c30971b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:47 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ed9451ec-b164-49ce-8bdd-7d493c30971b Feb 27 02:07:47 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-abc489f9-8aa3-4703-a1d8-a911cd1bce25 tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "cinder-169a7a86-a413-4ea2-92fe-b0e119de223c-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-abc489f9-8aa3-4703-a1d8-a911cd1bce25 tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-169a7a86-a413-4ea2-92fe-b0e119de223c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-abc489f9-8aa3-4703-a1d8-a911cd1bce25 tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "cinder-quobyte-169a7a86-a413-4ea2-92fe-b0e119de223c" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-abc489f9-8aa3-4703-a1d8-a911cd1bce25 tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-quobyte-169a7a86-a413-4ea2-92fe-b0e119de223c" acquired by "delete_volume" :: waited 0.022s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:47 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[198955f9-b8df-4530-86bb-30419628b55f]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-abc489f9-8aa3-4703-a1d8-a911cd1bce25 tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-169a7a86-a413-4ea2-92fe-b0e119de223c {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:48 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ed9451ec-b164-49ce-8bdd-7d493c30971b" returned: 0 in 0.838s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:48 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e739cf-cdaa-411e-b60c-88b4a49a7434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed9451ec-b164-49ce-8bdd-7d493c30971b', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707d71d1-f94e-4803-bf6d-b8aa0c3a8c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:48 devstack sudo[88708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-169a7a86-a413-4ea2-92fe-b0e119de223c Feb 27 02:07:48 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:48 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Volume volume-ed9451ec-b164-49ce-8bdd-7d493c30971b (ed9451ec-b164-49ce-8bdd-7d493c30971b): created successfully Feb 27 02:07:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707d71d1-f94e-4803-bf6d-b8aa0c3a8c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Flow 'volume_create_manager' (2ff31b9d-59f8-4313-8f8e-06b081ab8c81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:48 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-95de4c45-b100-4038-9311-5c6b76401623 tempest-VolumesNegativeTest-381880089 None] Created volume successfully. Feb 27 02:07:48 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-abc489f9-8aa3-4703-a1d8-a911cd1bce25 tempest-VolumeDependencyTests-1347283663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-169a7a86-a413-4ea2-92fe-b0e119de223c" returned: 0 in 1.060s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-abc489f9-8aa3-4703-a1d8-a911cd1bce25 tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-169a7a86-a413-4ea2-92fe-b0e119de223c {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:49 devstack sudo[88715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-169a7a86-a413-4ea2-92fe-b0e119de223c Feb 27 02:07:49 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] Acquiring lock "cinder-e0e9b7cc-add1-4cc9-a346-c073883051e5-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-e0e9b7cc-add1-4cc9-a346-c073883051e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] Acquiring lock "cinder-quobyte-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-quobyte-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] Acquiring lock "cinder-quobyte-e0e9b7cc-add1-4cc9-a346-c073883051e5" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-quobyte-e0e9b7cc-add1-4cc9-a346-c073883051e5" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] Deleting offline snapshot e0e9b7cc-add1-4cc9-a346-c073883051e5 of volume 17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] snapshot_file for this snap is: volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.e0e9b7cc-add1-4cc9-a346-c073883051e5 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0bfb8c-d182-45d7-a4e8-b4d845922799]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.e0e9b7cc-add1-4cc9-a346-c073883051e5 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:49 devstack sudo[88717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.e0e9b7cc-add1-4cc9-a346-c073883051e5 Feb 27 02:07:49 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:49 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-abc489f9-8aa3-4703-a1d8-a911cd1bce25 tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-169a7a86-a413-4ea2-92fe-b0e119de223c" returned: 0 in 0.691s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-abc489f9-8aa3-4703-a1d8-a911cd1bce25 tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-quobyte-169a7a86-a413-4ea2-92fe-b0e119de223c" released by "delete_volume" :: held 1.798s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-abc489f9-8aa3-4703-a1d8-a911cd1bce25 tempest-VolumeDependencyTests-1347283663 None] Created reservations ['3bdf83c3-55b8-43c8-ae2e-9837744c432f', '435cf78e-843a-44ee-b41d-780aec34cf20', '685b1508-9650-4166-a3c5-e723d5427291', '0624f013-6c8d-414a-96d5-0feab402e0e3'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-abc489f9-8aa3-4703-a1d8-a911cd1bce25 tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-abc489f9-8aa3-4703-a1d8-a911cd1bce25 tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-abc489f9-8aa3-4703-a1d8-a911cd1bce25 tempest-VolumeDependencyTests-1347283663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-abc489f9-8aa3-4703-a1d8-a911cd1bce25 tempest-VolumeDependencyTests-1347283663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-abc489f9-8aa3-4703-a1d8-a911cd1bce25 tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-abc489f9-8aa3-4703-a1d8-a911cd1bce25 tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:49 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.e0e9b7cc-add1-4cc9-a346-c073883051e5" returned: 0 in 0.753s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:49 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:07:49 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d8f719-7e36-40bd-8923-a3159fe7b81a]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:50 devstack sudo[88727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 Feb 27 02:07:50 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6d184efc-ab9d-493c-bdd9-f786fb962033 tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "cinder-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6d184efc-ab9d-493c-bdd9-f786fb962033 tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6d184efc-ab9d-493c-bdd9-f786fb962033 tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "cinder-quobyte-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6d184efc-ab9d-493c-bdd9-f786fb962033 tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-quobyte-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[644ecd8b-30a2-492b-bcea-0a847b1d4383]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6d184efc-ab9d-493c-bdd9-f786fb962033 tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:50 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6 Feb 27 02:07:50 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:50 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-abc489f9-8aa3-4703-a1d8-a911cd1bce25 tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.852s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-abc489f9-8aa3-4703-a1d8-a911cd1bce25 tempest-VolumeDependencyTests-1347283663 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:50 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-abc489f9-8aa3-4703-a1d8-a911cd1bce25 tempest-VolumeDependencyTests-1347283663 None] Deleted volume successfully. Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-abc489f9-8aa3-4703-a1d8-a911cd1bce25 tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-169a7a86-a413-4ea2-92fe-b0e119de223c-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Flow 'volume_create_manager' (ce784226-3ca3-428a-8869-93af4351f620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5fad89-8536-4af7-aed2-98bf1a3dbdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5fad89-8536-4af7-aed2-98bf1a3dbdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-373652260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57d0a97-92b8-4628-9bdd-380395165b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce005f0fd8a40db8b935f6b322a73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:51Z,use_quota=True,user_id='8a80b48e5d4b4644b70828701f5404f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089aea58-2c11-404c-bdcb-644648d90310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089aea58-2c11-404c-bdcb-644648d90310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b8cd1a-179b-4b34-a06b-bbaf740e6ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b8cd1a-179b-4b34-a06b-bbaf740e6ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b57d0a97-92b8-4628-9bdd-380395165b6f', 'volume_name': 'volume-b57d0a97-92b8-4628-9bdd-380395165b6f', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34804e2a-38a4-46bc-91e9-2c33761008b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34804e2a-38a4-46bc-91e9-2c33761008b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78d48a7-5605-4651-adc2-21aa49045f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:50 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Volume b57d0a97-92b8-4628-9bdd-380395165b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b57d0a97-92b8-4628-9bdd-380395165b6f', 'volume_size': 1} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-373652260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57d0a97-92b8-4628-9bdd-380395165b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce005f0fd8a40db8b935f6b322a73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:07:51Z,use_quota=True,user_id='8a80b48e5d4b4644b70828701f5404f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Creating volume b57d0a97-92b8-4628-9bdd-380395165b6f {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:07:50 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b57d0a97-92b8-4628-9bdd-380395165b6f 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:50 devstack sudo[88738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b57d0a97-92b8-4628-9bdd-380395165b6f 1073741824 Feb 27 02:07:50 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:50 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67" returned: 0 in 1.085s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.e0e9b7cc-add1-4cc9-a346-c073883051e5 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:50 devstack sudo[88740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.e0e9b7cc-add1-4cc9-a346-c073883051e5 Feb 27 02:07:50 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:51 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6d184efc-ab9d-493c-bdd9-f786fb962033 tempest-VolumeDependencyTests-1347283663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6" returned: 0 in 0.767s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6d184efc-ab9d-493c-bdd9-f786fb962033 tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:51 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6 Feb 27 02:07:51 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:51 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b57d0a97-92b8-4628-9bdd-380395165b6f 1073741824" returned: 0 in 0.649s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b57d0a97-92b8-4628-9bdd-380395165b6f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:51 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6d184efc-ab9d-493c-bdd9-f786fb962033 tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6" returned: 0 in 0.566s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:51 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b57d0a97-92b8-4628-9bdd-380395165b6f Feb 27 02:07:51 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6d184efc-ab9d-493c-bdd9-f786fb962033 tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-quobyte-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6" released by "delete_volume" :: held 1.369s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:51 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:51 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.e0e9b7cc-add1-4cc9-a346-c073883051e5" returned: 0 in 0.633s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.e0e9b7cc-add1-4cc9-a346-c073883051e5 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:51 devstack sudo[88753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.e0e9b7cc-add1-4cc9-a346-c073883051e5 Feb 27 02:07:51 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:51 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-6d184efc-ab9d-493c-bdd9-f786fb962033 tempest-VolumeDependencyTests-1347283663 None] Created reservations ['9c564e26-7991-45d7-87ff-51c3e3ebab83', '0a1a516d-58cd-4df8-b031-3019f4822e43', 'ab745cea-802d-4ae7-ae5f-397439bcd160', '4a867a6f-020d-4784-9872-ce1a2d2b79a6'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6d184efc-ab9d-493c-bdd9-f786fb962033 tempest-VolumeDependencyTests-1347283663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6d184efc-ab9d-493c-bdd9-f786fb962033 tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:51 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6d184efc-ab9d-493c-bdd9-f786fb962033 tempest-VolumeDependencyTests-1347283663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:51 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6d184efc-ab9d-493c-bdd9-f786fb962033 tempest-VolumeDependencyTests-1347283663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6d184efc-ab9d-493c-bdd9-f786fb962033 tempest-VolumeDependencyTests-1347283663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6d184efc-ab9d-493c-bdd9-f786fb962033 tempest-VolumeDependencyTests-1347283663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:51 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:07:51 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:52 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.e0e9b7cc-add1-4cc9-a346-c073883051e5" returned: 0 in 0.511s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-quobyte-e0e9b7cc-add1-4cc9-a346-c073883051e5" released by "_delete_snapshot" :: held 3.074s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-quobyte-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42" released by "delete_snapshot" :: held 3.092s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:52 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b57d0a97-92b8-4628-9bdd-380395165b6f" returned: 0 in 0.613s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:52 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:07:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78d48a7-5605-4651-adc2-21aa49045f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b57d0a97-92b8-4628-9bdd-380395165b6f', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb96b20-562f-468c-be7f-684adaa7fbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:07:52 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Volume volume-b57d0a97-92b8-4628-9bdd-380395165b6f (b57d0a97-92b8-4628-9bdd-380395165b6f): created successfully Feb 27 02:07:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb96b20-562f-468c-be7f-684adaa7fbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:07:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Flow 'volume_create_manager' (ce784226-3ca3-428a-8869-93af4351f620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:07:52 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-ccdeafef-44c3-499c-9758-536dfc010889 tempest-VolumesActionsTest-378782857 None] Created volume successfully. Feb 27 02:07:52 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] Created reservations ['a082192f-0871-4f19-951c-33b99455b7be', 'e271365b-c55f-4cf9-b522-75decf36d535', '5edba4ad-ae74-4398-9dfc-75909dd8c050', '0674e724-bf93-4ebc-85f9-64b68c9c627c'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:52 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6d184efc-ab9d-493c-bdd9-f786fb962033 tempest-VolumeDependencyTests-1347283663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.534s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:52 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-6d184efc-ab9d-493c-bdd9-f786fb962033 tempest-VolumeDependencyTests-1347283663 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:52 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-6d184efc-ab9d-493c-bdd9-f786fb962033 tempest-VolumeDependencyTests-1347283663 None] Deleted volume successfully. Feb 27 02:07:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6d184efc-ab9d-493c-bdd9-f786fb962033 tempest-VolumeDependencyTests-1347283663 None] Lock "cinder-773e53f5-29cb-423b-8d0e-a72d8fe1c2f6-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:52 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] Delete snapshot completed successfully. Feb 27 02:07:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f6352d7e-91ad-4e4a-af3c-a0b6ae2aa874 tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-e0e9b7cc-add1-4cc9-a346-c073883051e5-delete_snapshot" released by "delete_snapshot" :: held 3.245s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6225be35-faa4-47e3-b1ef-5f9fca3402e1 tempest-VolumesActionsTest-378782857 None] Acquiring lock "cinder-b57d0a97-92b8-4628-9bdd-380395165b6f" by "attach_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6225be35-faa4-47e3-b1ef-5f9fca3402e1 tempest-VolumesActionsTest-378782857 None] Lock "cinder-b57d0a97-92b8-4628-9bdd-380395165b6f" acquired by "attach_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:53 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-6225be35-faa4-47e3-b1ef-5f9fca3402e1 tempest-VolumesActionsTest-378782857 None] Attaching volume b57d0a97-92b8-4628-9bdd-380395165b6f to instance a9c39c8c-2799-4572-9abd-115dd86ce122 at mountpoint /dev/vdb on host None. Feb 27 02:07:53 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-6225be35-faa4-47e3-b1ef-5f9fca3402e1 tempest-VolumesActionsTest-378782857 None] Attach volume completed successfully. Feb 27 02:07:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6225be35-faa4-47e3-b1ef-5f9fca3402e1 tempest-VolumesActionsTest-378782857 None] Lock "cinder-b57d0a97-92b8-4628-9bdd-380395165b6f" released by "attach_volume" :: held 0.100s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] Acquiring lock "cinder-ec6df714-6187-45bb-b2d0-f1b9d5d52d67-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-ec6df714-6187-45bb-b2d0-f1b9d5d52d67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] Acquiring lock "cinder-quobyte-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-quobyte-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] Acquiring lock "cinder-quobyte-ec6df714-6187-45bb-b2d0-f1b9d5d52d67" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-quobyte-ec6df714-6187-45bb-b2d0-f1b9d5d52d67" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:53 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] Deleting offline snapshot ec6df714-6187-45bb-b2d0-f1b9d5d52d67 of volume 17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:53 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] snapshot_file for this snap is: volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:53 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9991847-1533-4171-91a9-9ea977228d20]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:53 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 Feb 27 02:07:53 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:53 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67" returned: 0 in 0.563s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:53 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:53 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[970af6a5-3f88-4db0-8662-7cc7cb3d95f0]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:54 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-9fd3440b-f393-4bb7-8e56-d623f8e0d053 tempest-VolumesActionsTest-2040883694 None] Terminate volume connection completed successfully. Feb 27 02:07:54 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff Feb 27 02:07:54 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:54 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff" returned: 0 in 0.551s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:54 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:54 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9fd3440b-f393-4bb7-8e56-d623f8e0d053 tempest-VolumesActionsTest-2040883694 None] Acquiring lock "cinder-b57d0a97-92b8-4628-9bdd-380395165b6f-detach_volume" by "detach_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:54 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 Feb 27 02:07:54 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:54 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9fd3440b-f393-4bb7-8e56-d623f8e0d053 tempest-VolumesActionsTest-2040883694 None] Lock "cinder-b57d0a97-92b8-4628-9bdd-380395165b6f-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:54 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-9fd3440b-f393-4bb7-8e56-d623f8e0d053 tempest-VolumesActionsTest-2040883694 None] Detaching volume b57d0a97-92b8-4628-9bdd-380395165b6f from instance a9c39c8c-2799-4572-9abd-115dd86ce122. Feb 27 02:07:54 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-9fd3440b-f393-4bb7-8e56-d623f8e0d053 tempest-VolumesActionsTest-2040883694 None] Detach volume completed successfully. Feb 27 02:07:54 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9fd3440b-f393-4bb7-8e56-d623f8e0d053 tempest-VolumesActionsTest-2040883694 None] Lock "cinder-b57d0a97-92b8-4628-9bdd-380395165b6f-detach_volume" released by "detach_volume" :: held 0.077s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-20828b47-8bf7-4d32-aa97-094715af274d tempest-VolumesActionsTest-378782857 None] Acquiring lock "cinder-b57d0a97-92b8-4628-9bdd-380395165b6f-detach_volume" by "detach_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-20828b47-8bf7-4d32-aa97-094715af274d tempest-VolumesActionsTest-378782857 None] Lock "cinder-b57d0a97-92b8-4628-9bdd-380395165b6f-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:55 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-20828b47-8bf7-4d32-aa97-094715af274d tempest-VolumesActionsTest-378782857 None] Volume detach called, but volume not attached. Feb 27 02:07:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-20828b47-8bf7-4d32-aa97-094715af274d tempest-VolumesActionsTest-378782857 None] Lock "cinder-b57d0a97-92b8-4628-9bdd-380395165b6f-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:55 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67" returned: 0 in 0.862s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:55 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67 Feb 27 02:07:55 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-dcecc10b-3846-4b32-8ee5-f9e3ae387593 tempest-VolumesActionsTest-378782857 None] Acquiring lock "cinder-b57d0a97-92b8-4628-9bdd-380395165b6f-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-dcecc10b-3846-4b32-8ee5-f9e3ae387593 tempest-VolumesActionsTest-378782857 None] Lock "cinder-b57d0a97-92b8-4628-9bdd-380395165b6f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-dcecc10b-3846-4b32-8ee5-f9e3ae387593 tempest-VolumesActionsTest-378782857 None] Acquiring lock "cinder-quobyte-b57d0a97-92b8-4628-9bdd-380395165b6f" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-dcecc10b-3846-4b32-8ee5-f9e3ae387593 tempest-VolumesActionsTest-378782857 None] Lock "cinder-quobyte-b57d0a97-92b8-4628-9bdd-380395165b6f" acquired by "delete_volume" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:56 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0c6141-5595-426a-adda-603a1f4eb0a2]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-dcecc10b-3846-4b32-8ee5-f9e3ae387593 tempest-VolumesActionsTest-378782857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b57d0a97-92b8-4628-9bdd-380395165b6f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:56 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b57d0a97-92b8-4628-9bdd-380395165b6f Feb 27 02:07:56 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:56 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.ec6df714-6187-45bb-b2d0-f1b9d5d52d67" returned: 0 in 0.827s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-quobyte-ec6df714-6187-45bb-b2d0-f1b9d5d52d67" released by "_delete_snapshot" :: held 2.909s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-quobyte-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42" released by "delete_snapshot" :: held 2.925s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:56 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] Created reservations ['cbf5b733-b243-40c5-b6ad-f0c9cada5c6b', '5a2c95c5-a975-4734-aa5a-4254001f9ab5', '4f33c1c8-0cec-4da6-a5f9-4662a38cc424', 'ed832266-225c-4394-b6cb-156cf601bef1'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:56 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] Delete snapshot completed successfully. Feb 27 02:07:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-05bf7269-302f-4e31-974b-e7f113cc284b tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-ec6df714-6187-45bb-b2d0-f1b9d5d52d67-delete_snapshot" released by "delete_snapshot" :: held 3.124s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] Acquiring lock "cinder-4396e4c8-d9d4-45d5-bdad-40ed7c94caff-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-4396e4c8-d9d4-45d5-bdad-40ed7c94caff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] Acquiring lock "cinder-quobyte-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-quobyte-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] Acquiring lock "cinder-quobyte-4396e4c8-d9d4-45d5-bdad-40ed7c94caff" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-quobyte-4396e4c8-d9d4-45d5-bdad-40ed7c94caff" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] Deleting offline snapshot 4396e4c8-d9d4-45d5-bdad-40ed7c94caff of volume 17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:07:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] snapshot_file for this snap is: volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:07:56 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1862a4df-b59b-42d0-a404-31396b62aa82]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:56 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff Feb 27 02:07:56 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:56 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-dcecc10b-3846-4b32-8ee5-f9e3ae387593 tempest-VolumesActionsTest-378782857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b57d0a97-92b8-4628-9bdd-380395165b6f" returned: 0 in 0.890s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-dcecc10b-3846-4b32-8ee5-f9e3ae387593 tempest-VolumesActionsTest-378782857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b57d0a97-92b8-4628-9bdd-380395165b6f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:56 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b57d0a97-92b8-4628-9bdd-380395165b6f Feb 27 02:07:56 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:57 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff" returned: 0 in 0.610s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:07:57 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9692177f-7c3b-4328-a325-d36656810ce8]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:57 devstack sudo[88806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 Feb 27 02:07:57 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:57 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-dcecc10b-3846-4b32-8ee5-f9e3ae387593 tempest-VolumesActionsTest-378782857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b57d0a97-92b8-4628-9bdd-380395165b6f" returned: 0 in 0.556s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-dcecc10b-3846-4b32-8ee5-f9e3ae387593 tempest-VolumesActionsTest-378782857 None] Lock "cinder-quobyte-b57d0a97-92b8-4628-9bdd-380395165b6f" released by "delete_volume" :: held 1.475s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:57 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-dcecc10b-3846-4b32-8ee5-f9e3ae387593 tempest-VolumesActionsTest-378782857 None] Created reservations ['a7253d9f-3432-4e02-96b1-7c949698ea3d', 'c1e71c11-3984-4169-b245-83224b22199b', '30cdbfc8-633c-4075-9013-b85f61ce5b7a', 'a4d67bf8-da27-49e2-807d-5bb8719828ac'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-dcecc10b-3846-4b32-8ee5-f9e3ae387593 tempest-VolumesActionsTest-378782857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:07:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-dcecc10b-3846-4b32-8ee5-f9e3ae387593 tempest-VolumesActionsTest-378782857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:07:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-dcecc10b-3846-4b32-8ee5-f9e3ae387593 tempest-VolumesActionsTest-378782857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:07:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-dcecc10b-3846-4b32-8ee5-f9e3ae387593 tempest-VolumesActionsTest-378782857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:07:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-dcecc10b-3846-4b32-8ee5-f9e3ae387593 tempest-VolumesActionsTest-378782857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:07:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-dcecc10b-3846-4b32-8ee5-f9e3ae387593 tempest-VolumesActionsTest-378782857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:57 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:07:57 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:57 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42" returned: 0 in 0.679s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:57 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff Feb 27 02:07:57 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:58 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-dcecc10b-3846-4b32-8ee5-f9e3ae387593 tempest-VolumesActionsTest-378782857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.676s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:58 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-dcecc10b-3846-4b32-8ee5-f9e3ae387593 tempest-VolumesActionsTest-378782857 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:07:58 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-dcecc10b-3846-4b32-8ee5-f9e3ae387593 tempest-VolumesActionsTest-378782857 None] Deleted volume successfully. Feb 27 02:07:58 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-dcecc10b-3846-4b32-8ee5-f9e3ae387593 tempest-VolumesActionsTest-378782857 None] Lock "cinder-b57d0a97-92b8-4628-9bdd-380395165b6f-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:58 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff" returned: 0 in 0.732s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:58 devstack sudo[88821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff Feb 27 02:07:58 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:07:59 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root Feb 27 02:07:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42.4396e4c8-d9d4-45d5-bdad-40ed7c94caff" returned: 0 in 0.479s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:07:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-quobyte-4396e4c8-d9d4-45d5-bdad-40ed7c94caff" released by "_delete_snapshot" :: held 2.563s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-quobyte-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42" released by "delete_snapshot" :: held 2.578s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:59 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] Created reservations ['8cd40c03-00bb-4de6-9fdc-75467964dece', 'ddb9a7e3-ff0b-4e23-a77b-7b183a4a94b4', '339461c3-6f0b-4ad7-912a-f6293d350b10', 'd5cda34a-9aa5-4f9c-94f9-b127da8149c2'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:07:59 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] Delete snapshot completed successfully. Feb 27 02:07:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2e80b50c-19ed-41f0-8987-f1f4998b480e tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-4396e4c8-d9d4-45d5-bdad-40ed7c94caff-delete_snapshot" released by "delete_snapshot" :: held 2.698s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:07:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-17b24d50-684d-470a-a7cf-01bdc4a48ea2 tempest-VolumesSnapshotListTestJSON-934178089 None] Acquiring lock "cinder-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-17b24d50-684d-470a-a7cf-01bdc4a48ea2 tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-17b24d50-684d-470a-a7cf-01bdc4a48ea2 tempest-VolumesSnapshotListTestJSON-934178089 None] Acquiring lock "cinder-quobyte-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:07:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-17b24d50-684d-470a-a7cf-01bdc4a48ea2 tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-quobyte-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:07:59 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f587bb4e-02cf-4b87-a024-30569c7d9ca4]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:07:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-17b24d50-684d-470a-a7cf-01bdc4a48ea2 tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:07:59 devstack sudo[88856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 Feb 27 02:07:59 devstack sudo[88856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:00 devstack sudo[88856]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-17b24d50-684d-470a-a7cf-01bdc4a48ea2 tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42" returned: 0 in 0.516s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-17b24d50-684d-470a-a7cf-01bdc4a48ea2 tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:00 devstack sudo[88865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42 Feb 27 02:08:00 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:00 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-17b24d50-684d-470a-a7cf-01bdc4a48ea2 tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42" returned: 0 in 0.550s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:00 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-17b24d50-684d-470a-a7cf-01bdc4a48ea2 tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-quobyte-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42" released by "delete_volume" :: held 1.106s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:01 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-17b24d50-684d-470a-a7cf-01bdc4a48ea2 tempest-VolumesSnapshotListTestJSON-934178089 None] Created reservations ['b25df410-5d7c-42d5-8a23-61afa147200f', 'e9041437-3569-41bb-b15b-4bc399e1ea7d', '72fa1367-e641-4267-89ca-c3d0ea343350', 'fde5e16e-9629-4c63-b127-8bbddc01d802'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-17b24d50-684d-470a-a7cf-01bdc4a48ea2 tempest-VolumesSnapshotListTestJSON-934178089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-17b24d50-684d-470a-a7cf-01bdc4a48ea2 tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-17b24d50-684d-470a-a7cf-01bdc4a48ea2 tempest-VolumesSnapshotListTestJSON-934178089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-17b24d50-684d-470a-a7cf-01bdc4a48ea2 tempest-VolumesSnapshotListTestJSON-934178089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-17b24d50-684d-470a-a7cf-01bdc4a48ea2 tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-17b24d50-684d-470a-a7cf-01bdc4a48ea2 tempest-VolumesSnapshotListTestJSON-934178089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:01 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:08:01 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:01 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-17b24d50-684d-470a-a7cf-01bdc4a48ea2 tempest-VolumesSnapshotListTestJSON-934178089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.553s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:01 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-17b24d50-684d-470a-a7cf-01bdc4a48ea2 tempest-VolumesSnapshotListTestJSON-934178089 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:01 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-17b24d50-684d-470a-a7cf-01bdc4a48ea2 tempest-VolumesSnapshotListTestJSON-934178089 None] Deleted volume successfully. Feb 27 02:08:01 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-17b24d50-684d-470a-a7cf-01bdc4a48ea2 tempest-VolumesSnapshotListTestJSON-934178089 None] Lock "cinder-17e4fef5-aaf2-4ee8-bbba-8ecdda8b5c42-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Flow 'volume_create_manager' (9bba0ead-5ddf-414f-a707-bfc539cddfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd0ae0c-ff5c-4ab7-88ea-af1a4abe3694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd0ae0c-ff5c-4ab7-88ea-af1a4abe3694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-261018686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b742b70-b37f-45e0-87ec-97e2d33c1fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce005f0fd8a40db8b935f6b322a73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:05Z,use_quota=True,user_id='8a80b48e5d4b4644b70828701f5404f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454ec7e7-4e32-450d-8a63-ce881918b43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454ec7e7-4e32-450d-8a63-ce881918b43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b39742c-9840-4d25-af5a-8afa28206e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b39742c-9840-4d25-af5a-8afa28206e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b742b70-b37f-45e0-87ec-97e2d33c1fda', 'volume_name': 'volume-1b742b70-b37f-45e0-87ec-97e2d33c1fda', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23441695-e377-4fcf-8790-e4d4078bd990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23441695-e377-4fcf-8790-e4d4078bd990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c09436-0c7c-4be0-997c-5ad74b77a68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:04 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Volume 1b742b70-b37f-45e0-87ec-97e2d33c1fda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b742b70-b37f-45e0-87ec-97e2d33c1fda', 'volume_size': 1} Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-261018686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b742b70-b37f-45e0-87ec-97e2d33c1fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce005f0fd8a40db8b935f6b322a73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:05Z,use_quota=True,user_id='8a80b48e5d4b4644b70828701f5404f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Creating volume 1b742b70-b37f-45e0-87ec-97e2d33c1fda {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:04 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:08:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1b742b70-b37f-45e0-87ec-97e2d33c1fda 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:05 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1b742b70-b37f-45e0-87ec-97e2d33c1fda 1073741824 Feb 27 02:08:05 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:05 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1b742b70-b37f-45e0-87ec-97e2d33c1fda 1073741824" returned: 0 in 0.673s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1b742b70-b37f-45e0-87ec-97e2d33c1fda {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:05 devstack sudo[88929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1b742b70-b37f-45e0-87ec-97e2d33c1fda Feb 27 02:08:05 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:06 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1b742b70-b37f-45e0-87ec-97e2d33c1fda" returned: 0 in 0.443s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:06 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c09436-0c7c-4be0-997c-5ad74b77a68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b742b70-b37f-45e0-87ec-97e2d33c1fda', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (011e76cb-61c5-4940-875e-779c2f908704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:06 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Volume volume-1b742b70-b37f-45e0-87ec-97e2d33c1fda (1b742b70-b37f-45e0-87ec-97e2d33c1fda): created successfully Feb 27 02:08:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (011e76cb-61c5-4940-875e-779c2f908704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Flow 'volume_create_manager' (9bba0ead-5ddf-414f-a707-bfc539cddfcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:06 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-be8a883f-9f78-4421-9f7e-faf746f4cebe tempest-VolumesActionsTest-378782857 None] Created volume successfully. Feb 27 02:08:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2836cb95-35fd-4029-83e5-8fe4a475d179 tempest-VolumesActionsTest-2040883694 None] Acquiring lock "cinder-1b742b70-b37f-45e0-87ec-97e2d33c1fda-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2836cb95-35fd-4029-83e5-8fe4a475d179 tempest-VolumesActionsTest-2040883694 None] Lock "cinder-1b742b70-b37f-45e0-87ec-97e2d33c1fda-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2836cb95-35fd-4029-83e5-8fe4a475d179 tempest-VolumesActionsTest-2040883694 None] Acquiring lock "cinder-quobyte-1b742b70-b37f-45e0-87ec-97e2d33c1fda" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2836cb95-35fd-4029-83e5-8fe4a475d179 tempest-VolumesActionsTest-2040883694 None] Lock "cinder-quobyte-1b742b70-b37f-45e0-87ec-97e2d33c1fda" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:07 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4893b974-47ae-4dc8-bac2-740ef1c9fb69]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2836cb95-35fd-4029-83e5-8fe4a475d179 tempest-VolumesActionsTest-2040883694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1b742b70-b37f-45e0-87ec-97e2d33c1fda {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:07 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1b742b70-b37f-45e0-87ec-97e2d33c1fda Feb 27 02:08:07 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:07 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2836cb95-35fd-4029-83e5-8fe4a475d179 tempest-VolumesActionsTest-2040883694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1b742b70-b37f-45e0-87ec-97e2d33c1fda" returned: 0 in 0.549s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2836cb95-35fd-4029-83e5-8fe4a475d179 tempest-VolumesActionsTest-2040883694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1b742b70-b37f-45e0-87ec-97e2d33c1fda {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:07 devstack sudo[88972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1b742b70-b37f-45e0-87ec-97e2d33c1fda Feb 27 02:08:07 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:08 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2836cb95-35fd-4029-83e5-8fe4a475d179 tempest-VolumesActionsTest-2040883694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-1b742b70-b37f-45e0-87ec-97e2d33c1fda" returned: 0 in 0.490s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:08 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2836cb95-35fd-4029-83e5-8fe4a475d179 tempest-VolumesActionsTest-2040883694 None] Lock "cinder-quobyte-1b742b70-b37f-45e0-87ec-97e2d33c1fda" released by "delete_volume" :: held 1.063s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:08 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-2836cb95-35fd-4029-83e5-8fe4a475d179 tempest-VolumesActionsTest-2040883694 None] Created reservations ['8e2cb718-a39d-41a3-9541-c77914af3d15', 'bfb16494-98aa-4c36-9100-b7b864cebbc7', '19035c50-ef9e-4555-aeb1-ea1fe3915613', '1d42c155-88c3-43a1-a9f6-4f4123479cae'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2836cb95-35fd-4029-83e5-8fe4a475d179 tempest-VolumesActionsTest-2040883694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2836cb95-35fd-4029-83e5-8fe4a475d179 tempest-VolumesActionsTest-2040883694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:08 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2836cb95-35fd-4029-83e5-8fe4a475d179 tempest-VolumesActionsTest-2040883694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:08 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2836cb95-35fd-4029-83e5-8fe4a475d179 tempest-VolumesActionsTest-2040883694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2836cb95-35fd-4029-83e5-8fe4a475d179 tempest-VolumesActionsTest-2040883694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2836cb95-35fd-4029-83e5-8fe4a475d179 tempest-VolumesActionsTest-2040883694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:08 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:08:08 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:08 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2836cb95-35fd-4029-83e5-8fe4a475d179 tempest-VolumesActionsTest-2040883694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.444s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:08 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-2836cb95-35fd-4029-83e5-8fe4a475d179 tempest-VolumesActionsTest-2040883694 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:08 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-2836cb95-35fd-4029-83e5-8fe4a475d179 tempest-VolumesActionsTest-2040883694 None] Deleted volume successfully. Feb 27 02:08:08 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2836cb95-35fd-4029-83e5-8fe4a475d179 tempest-VolumesActionsTest-2040883694 None] Lock "cinder-1b742b70-b37f-45e0-87ec-97e2d33c1fda-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG oslo_service.periodic_task [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:09 devstack sudo[88985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:08:09 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Flow 'volume_create_manager' (6612e3b1-00cd-4ce0-ac56-d7a747d413c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd034c83-173a-4fb2-b6ed-a89848e33007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd034c83-173a-4fb2-b6ed-a89848e33007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-667124288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bdeff84-4518-4514-9195-794fc85a6ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce005f0fd8a40db8b935f6b322a73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:10Z,use_quota=True,user_id='8a80b48e5d4b4644b70828701f5404f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a317a05-dffa-4d74-9c75-222b3d962246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a317a05-dffa-4d74-9c75-222b3d962246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71c184a-3363-43cb-b3c4-1b6cfaaf1ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71c184a-3363-43cb-b3c4-1b6cfaaf1ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bdeff84-4518-4514-9195-794fc85a6ff8', 'volume_name': 'volume-8bdeff84-4518-4514-9195-794fc85a6ff8', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3ee6d1-8371-4258-85d8-1469540f4721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e3ee6d1-8371-4258-85d8-1469540f4721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fec2cf-d010-4cb7-8f5f-572c09433802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:09 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Volume 8bdeff84-4518-4514-9195-794fc85a6ff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bdeff84-4518-4514-9195-794fc85a6ff8', 'volume_size': 1} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-667124288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bdeff84-4518-4514-9195-794fc85a6ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce005f0fd8a40db8b935f6b322a73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:10Z,use_quota=True,user_id='8a80b48e5d4b4644b70828701f5404f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Creating volume 8bdeff84-4518-4514-9195-794fc85a6ff8 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:09 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8bdeff84-4518-4514-9195-794fc85a6ff8 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:09 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8bdeff84-4518-4514-9195-794fc85a6ff8 1073741824 Feb 27 02:08:09 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:09 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.602s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:09 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:10 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8bdeff84-4518-4514-9195-794fc85a6ff8 1073741824" returned: 0 in 0.620s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8bdeff84-4518-4514-9195-794fc85a6ff8 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:10 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8bdeff84-4518-4514-9195-794fc85a6ff8 Feb 27 02:08:10 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:10 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8bdeff84-4518-4514-9195-794fc85a6ff8" returned: 0 in 0.441s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:10 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fec2cf-d010-4cb7-8f5f-572c09433802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bdeff84-4518-4514-9195-794fc85a6ff8', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9ca261-6615-4d13-9a93-5b8aeb48409f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:10 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Volume volume-8bdeff84-4518-4514-9195-794fc85a6ff8 (8bdeff84-4518-4514-9195-794fc85a6ff8): created successfully Feb 27 02:08:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9ca261-6615-4d13-9a93-5b8aeb48409f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:10 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Flow 'volume_create_manager' (6612e3b1-00cd-4ce0-ac56-d7a747d413c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:10 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-d8542aa9-64b1-4b7f-aa62-d43d423bc462 tempest-VolumesActionsTest-378782857 None] Created volume successfully. Feb 27 02:08:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-85bd5290-7276-4bb7-a642-a25fada0bcaf tempest-VolumesActionsTest-2040883694 None] Acquiring lock "cinder-8bdeff84-4518-4514-9195-794fc85a6ff8-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-85bd5290-7276-4bb7-a642-a25fada0bcaf tempest-VolumesActionsTest-2040883694 None] Lock "cinder-8bdeff84-4518-4514-9195-794fc85a6ff8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:12 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:SELECT=119,cinder:DELETE=13,cinder:INSERT=49,cinder:UPDATE=159 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:08:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-85bd5290-7276-4bb7-a642-a25fada0bcaf tempest-VolumesActionsTest-2040883694 None] Acquiring lock "cinder-quobyte-8bdeff84-4518-4514-9195-794fc85a6ff8" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-85bd5290-7276-4bb7-a642-a25fada0bcaf tempest-VolumesActionsTest-2040883694 None] Lock "cinder-quobyte-8bdeff84-4518-4514-9195-794fc85a6ff8" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:12 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eee7416-91cf-4e6d-aa96-e99a567e2173]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-85bd5290-7276-4bb7-a642-a25fada0bcaf tempest-VolumesActionsTest-2040883694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8bdeff84-4518-4514-9195-794fc85a6ff8 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:12 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8bdeff84-4518-4514-9195-794fc85a6ff8 Feb 27 02:08:12 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:12 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-85bd5290-7276-4bb7-a642-a25fada0bcaf tempest-VolumesActionsTest-2040883694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8bdeff84-4518-4514-9195-794fc85a6ff8" returned: 0 in 0.616s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-85bd5290-7276-4bb7-a642-a25fada0bcaf tempest-VolumesActionsTest-2040883694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8bdeff84-4518-4514-9195-794fc85a6ff8 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:12 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8bdeff84-4518-4514-9195-794fc85a6ff8 Feb 27 02:08:12 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:13 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-85bd5290-7276-4bb7-a642-a25fada0bcaf tempest-VolumesActionsTest-2040883694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8bdeff84-4518-4514-9195-794fc85a6ff8" returned: 0 in 0.477s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-85bd5290-7276-4bb7-a642-a25fada0bcaf tempest-VolumesActionsTest-2040883694 None] Lock "cinder-quobyte-8bdeff84-4518-4514-9195-794fc85a6ff8" released by "delete_volume" :: held 1.118s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:13 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-85bd5290-7276-4bb7-a642-a25fada0bcaf tempest-VolumesActionsTest-2040883694 None] Created reservations ['af546536-735c-4f43-94e1-2bcb8804ce93', '858f0d4f-9024-42d5-8fb6-f900e1a99d85', '71da1ef7-e190-4222-95c6-e8c4783227dc', 'e0429c3b-d2f1-411c-873f-c4ce9fc54a57'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-85bd5290-7276-4bb7-a642-a25fada0bcaf tempest-VolumesActionsTest-2040883694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-85bd5290-7276-4bb7-a642-a25fada0bcaf tempest-VolumesActionsTest-2040883694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-85bd5290-7276-4bb7-a642-a25fada0bcaf tempest-VolumesActionsTest-2040883694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-85bd5290-7276-4bb7-a642-a25fada0bcaf tempest-VolumesActionsTest-2040883694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-85bd5290-7276-4bb7-a642-a25fada0bcaf tempest-VolumesActionsTest-2040883694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-85bd5290-7276-4bb7-a642-a25fada0bcaf tempest-VolumesActionsTest-2040883694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:13 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:08:13 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:13 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-85bd5290-7276-4bb7-a642-a25fada0bcaf tempest-VolumesActionsTest-2040883694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.495s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:13 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-85bd5290-7276-4bb7-a642-a25fada0bcaf tempest-VolumesActionsTest-2040883694 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:13 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-85bd5290-7276-4bb7-a642-a25fada0bcaf tempest-VolumesActionsTest-2040883694 None] Deleted volume successfully. Feb 27 02:08:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-85bd5290-7276-4bb7-a642-a25fada0bcaf tempest-VolumesActionsTest-2040883694 None] Lock "cinder-8bdeff84-4518-4514-9195-794fc85a6ff8-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Flow 'volume_create_manager' (b7f3b639-5df0-4ff2-b0ae-4e6161abc4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4cfa5b8-0d50-4cb9-a797-ce1c618581b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4cfa5b8-0d50-4cb9-a797-ce1c618581b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1787280427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60daac29-2e4e-4ace-9cee-ed2c37c3cf54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce005f0fd8a40db8b935f6b322a73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:14Z,use_quota=True,user_id='8a80b48e5d4b4644b70828701f5404f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c3d916-bd13-4573-9423-ce638f97cc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c3d916-bd13-4573-9423-ce638f97cc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1729a756-86dc-4056-a6b2-ed2df9ddd123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1729a756-86dc-4056-a6b2-ed2df9ddd123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60daac29-2e4e-4ace-9cee-ed2c37c3cf54', 'volume_name': 'volume-60daac29-2e4e-4ace-9cee-ed2c37c3cf54', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796f2877-9a79-4ad4-961b-f6432f731c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796f2877-9a79-4ad4-961b-f6432f731c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6d0815-d272-4214-83d9-75ab2c9ba0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:14 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Volume 60daac29-2e4e-4ace-9cee-ed2c37c3cf54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60daac29-2e4e-4ace-9cee-ed2c37c3cf54', 'volume_size': 1} Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1787280427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60daac29-2e4e-4ace-9cee-ed2c37c3cf54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce005f0fd8a40db8b935f6b322a73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:14Z,use_quota=True,user_id='8a80b48e5d4b4644b70828701f5404f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Creating volume 60daac29-2e4e-4ace-9cee-ed2c37c3cf54 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:14 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:08:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-60daac29-2e4e-4ace-9cee-ed2c37c3cf54 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:14 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-60daac29-2e4e-4ace-9cee-ed2c37c3cf54 1073741824 Feb 27 02:08:14 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:15 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-60daac29-2e4e-4ace-9cee-ed2c37c3cf54 1073741824" returned: 0 in 0.591s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-60daac29-2e4e-4ace-9cee-ed2c37c3cf54 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:15 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-60daac29-2e4e-4ace-9cee-ed2c37c3cf54 Feb 27 02:08:15 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:15 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-60daac29-2e4e-4ace-9cee-ed2c37c3cf54" returned: 0 in 0.467s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:15 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6d0815-d272-4214-83d9-75ab2c9ba0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60daac29-2e4e-4ace-9cee-ed2c37c3cf54', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4356f070-1b4c-4162-b287-ab0d4ff996cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:15 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Volume volume-60daac29-2e4e-4ace-9cee-ed2c37c3cf54 (60daac29-2e4e-4ace-9cee-ed2c37c3cf54): created successfully Feb 27 02:08:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4356f070-1b4c-4162-b287-ab0d4ff996cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Flow 'volume_create_manager' (b7f3b639-5df0-4ff2-b0ae-4e6161abc4fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:15 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:SELECT=123,cinder:UPDATE=162,cinder:INSERT=31,cinder:DELETE=14 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:08:15 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-3dbdb1ff-705d-4290-8143-45568ce7255f tempest-VolumesActionsTest-378782857 None] Created volume successfully. Feb 27 02:08:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-72f9c633-ce01-4f4e-aa11-711aeb1f3622 tempest-VolumesNegativeTest-381880089 None] Acquiring lock "cinder-ed9451ec-b164-49ce-8bdd-7d493c30971b-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-72f9c633-ce01-4f4e-aa11-711aeb1f3622 tempest-VolumesNegativeTest-381880089 None] Lock "cinder-ed9451ec-b164-49ce-8bdd-7d493c30971b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-72f9c633-ce01-4f4e-aa11-711aeb1f3622 tempest-VolumesNegativeTest-381880089 None] Acquiring lock "cinder-quobyte-ed9451ec-b164-49ce-8bdd-7d493c30971b" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-72f9c633-ce01-4f4e-aa11-711aeb1f3622 tempest-VolumesNegativeTest-381880089 None] Lock "cinder-quobyte-ed9451ec-b164-49ce-8bdd-7d493c30971b" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:15 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[75273997-1aa4-440e-ae28-971c27ff20b3]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-72f9c633-ce01-4f4e-aa11-711aeb1f3622 tempest-VolumesNegativeTest-381880089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ed9451ec-b164-49ce-8bdd-7d493c30971b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:16 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ed9451ec-b164-49ce-8bdd-7d493c30971b Feb 27 02:08:16 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:16 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-72f9c633-ce01-4f4e-aa11-711aeb1f3622 tempest-VolumesNegativeTest-381880089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ed9451ec-b164-49ce-8bdd-7d493c30971b" returned: 0 in 0.499s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-72f9c633-ce01-4f4e-aa11-711aeb1f3622 tempest-VolumesNegativeTest-381880089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ed9451ec-b164-49ce-8bdd-7d493c30971b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:16 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ed9451ec-b164-49ce-8bdd-7d493c30971b Feb 27 02:08:16 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:16 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1635304c-12ec-4b58-9007-ea22315d058c tempest-VolumesActionsTest-2040883694 None] Acquiring lock "cinder-60daac29-2e4e-4ace-9cee-ed2c37c3cf54-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:16 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1635304c-12ec-4b58-9007-ea22315d058c tempest-VolumesActionsTest-2040883694 None] Lock "cinder-60daac29-2e4e-4ace-9cee-ed2c37c3cf54-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:16 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1635304c-12ec-4b58-9007-ea22315d058c tempest-VolumesActionsTest-2040883694 None] Acquiring lock "cinder-quobyte-60daac29-2e4e-4ace-9cee-ed2c37c3cf54" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:16 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1635304c-12ec-4b58-9007-ea22315d058c tempest-VolumesActionsTest-2040883694 None] Lock "cinder-quobyte-60daac29-2e4e-4ace-9cee-ed2c37c3cf54" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:16 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dac9127-a6ca-4c87-a5cc-c6bd160281bf]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1635304c-12ec-4b58-9007-ea22315d058c tempest-VolumesActionsTest-2040883694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-60daac29-2e4e-4ace-9cee-ed2c37c3cf54 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:16 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-72f9c633-ce01-4f4e-aa11-711aeb1f3622 tempest-VolumesNegativeTest-381880089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ed9451ec-b164-49ce-8bdd-7d493c30971b" returned: 0 in 0.445s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:16 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-60daac29-2e4e-4ace-9cee-ed2c37c3cf54 Feb 27 02:08:16 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:16 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-72f9c633-ce01-4f4e-aa11-711aeb1f3622 tempest-VolumesNegativeTest-381880089 None] Lock "cinder-quobyte-ed9451ec-b164-49ce-8bdd-7d493c30971b" released by "delete_volume" :: held 0.978s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:16 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-72f9c633-ce01-4f4e-aa11-711aeb1f3622 tempest-VolumesNegativeTest-381880089 None] Created reservations ['71ce40be-e592-4a54-833e-ed9dc7e68085', '9629d8a9-866f-40f5-9448-6e92e4a708e5', '9526f159-c13a-4daa-becc-30417f1a5c72', '0c89f825-45a5-4b20-9fc5-f20adb08b2bc'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-72f9c633-ce01-4f4e-aa11-711aeb1f3622 tempest-VolumesNegativeTest-381880089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-72f9c633-ce01-4f4e-aa11-711aeb1f3622 tempest-VolumesNegativeTest-381880089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:17 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-72f9c633-ce01-4f4e-aa11-711aeb1f3622 tempest-VolumesNegativeTest-381880089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:17 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-72f9c633-ce01-4f4e-aa11-711aeb1f3622 tempest-VolumesNegativeTest-381880089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-72f9c633-ce01-4f4e-aa11-711aeb1f3622 tempest-VolumesNegativeTest-381880089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-72f9c633-ce01-4f4e-aa11-711aeb1f3622 tempest-VolumesNegativeTest-381880089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:17 devstack sudo[89027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:08:17 devstack sudo[89027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:17 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1635304c-12ec-4b58-9007-ea22315d058c tempest-VolumesActionsTest-2040883694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-60daac29-2e4e-4ace-9cee-ed2c37c3cf54" returned: 0 in 0.542s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1635304c-12ec-4b58-9007-ea22315d058c tempest-VolumesActionsTest-2040883694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-60daac29-2e4e-4ace-9cee-ed2c37c3cf54 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:17 devstack sudo[89033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-60daac29-2e4e-4ace-9cee-ed2c37c3cf54 Feb 27 02:08:17 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:17 devstack sudo[89027]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-72f9c633-ce01-4f4e-aa11-711aeb1f3622 tempest-VolumesNegativeTest-381880089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.418s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:17 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-72f9c633-ce01-4f4e-aa11-711aeb1f3622 tempest-VolumesNegativeTest-381880089 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:17 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-72f9c633-ce01-4f4e-aa11-711aeb1f3622 tempest-VolumesNegativeTest-381880089 None] Deleted volume successfully. Feb 27 02:08:17 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-72f9c633-ce01-4f4e-aa11-711aeb1f3622 tempest-VolumesNegativeTest-381880089 None] Lock "cinder-ed9451ec-b164-49ce-8bdd-7d493c30971b-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:17 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1635304c-12ec-4b58-9007-ea22315d058c tempest-VolumesActionsTest-2040883694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-60daac29-2e4e-4ace-9cee-ed2c37c3cf54" returned: 0 in 0.431s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:17 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1635304c-12ec-4b58-9007-ea22315d058c tempest-VolumesActionsTest-2040883694 None] Lock "cinder-quobyte-60daac29-2e4e-4ace-9cee-ed2c37c3cf54" released by "delete_volume" :: held 0.996s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:17 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-1635304c-12ec-4b58-9007-ea22315d058c tempest-VolumesActionsTest-2040883694 None] Created reservations ['1b116f2e-4621-496d-9c49-5229fad91482', '980e2d0a-9465-412f-b8f1-6705c0de38a8', '3c567611-1537-44d2-8ce6-a42d61a9a9e4', '00cc8a98-bfa8-416d-8954-6339c5d47673'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1635304c-12ec-4b58-9007-ea22315d058c tempest-VolumesActionsTest-2040883694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1635304c-12ec-4b58-9007-ea22315d058c tempest-VolumesActionsTest-2040883694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:17 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1635304c-12ec-4b58-9007-ea22315d058c tempest-VolumesActionsTest-2040883694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:17 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1635304c-12ec-4b58-9007-ea22315d058c tempest-VolumesActionsTest-2040883694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1635304c-12ec-4b58-9007-ea22315d058c tempest-VolumesActionsTest-2040883694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1635304c-12ec-4b58-9007-ea22315d058c tempest-VolumesActionsTest-2040883694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:17 devstack sudo[89036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:08:17 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:18 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1635304c-12ec-4b58-9007-ea22315d058c tempest-VolumesActionsTest-2040883694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.492s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:18 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-1635304c-12ec-4b58-9007-ea22315d058c tempest-VolumesActionsTest-2040883694 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:18 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-1635304c-12ec-4b58-9007-ea22315d058c tempest-VolumesActionsTest-2040883694 None] Deleted volume successfully. Feb 27 02:08:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1635304c-12ec-4b58-9007-ea22315d058c tempest-VolumesActionsTest-2040883694 None] Lock "cinder-60daac29-2e4e-4ace-9cee-ed2c37c3cf54-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Flow 'volume_create_manager' (5465f424-a979-43ae-aa8a-6d6c86731cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c491824b-69f1-4d33-a555-43c95d395d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c491824b-69f1-4d33-a555-43c95d395d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-285544049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bd5f1d-17b6-46e0-8467-9d314f630e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce005f0fd8a40db8b935f6b322a73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:19Z,use_quota=True,user_id='8a80b48e5d4b4644b70828701f5404f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b0b661-f3b7-4a68-b3bc-9ce20c4f8b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b0b661-f3b7-4a68-b3bc-9ce20c4f8b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f2aea0-2c7e-45bd-9c6a-529d08172e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f2aea0-2c7e-45bd-9c6a-529d08172e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2bd5f1d-17b6-46e0-8467-9d314f630e62', 'volume_name': 'volume-d2bd5f1d-17b6-46e0-8467-9d314f630e62', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b169549e-b860-4847-a662-39ec2181490e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b169549e-b860-4847-a662-39ec2181490e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b434b9-7a90-46d8-9e67-ed34b541d86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:19 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Volume d2bd5f1d-17b6-46e0-8467-9d314f630e62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2bd5f1d-17b6-46e0-8467-9d314f630e62', 'volume_size': 1} Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-285544049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bd5f1d-17b6-46e0-8467-9d314f630e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce005f0fd8a40db8b935f6b322a73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:19Z,use_quota=True,user_id='8a80b48e5d4b4644b70828701f5404f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Creating volume d2bd5f1d-17b6-46e0-8467-9d314f630e62 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:19 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d2bd5f1d-17b6-46e0-8467-9d314f630e62 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:19 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d2bd5f1d-17b6-46e0-8467-9d314f630e62 1073741824 Feb 27 02:08:19 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:19 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d2bd5f1d-17b6-46e0-8467-9d314f630e62 1073741824" returned: 0 in 0.638s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d2bd5f1d-17b6-46e0-8467-9d314f630e62 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:20 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d2bd5f1d-17b6-46e0-8467-9d314f630e62 Feb 27 02:08:20 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:20 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d2bd5f1d-17b6-46e0-8467-9d314f630e62" returned: 0 in 0.601s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:20 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b434b9-7a90-46d8-9e67-ed34b541d86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2bd5f1d-17b6-46e0-8467-9d314f630e62', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ba24c9-ceeb-481d-9537-1ee34b08c830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:20 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Volume volume-d2bd5f1d-17b6-46e0-8467-9d314f630e62 (d2bd5f1d-17b6-46e0-8467-9d314f630e62): created successfully Feb 27 02:08:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ba24c9-ceeb-481d-9537-1ee34b08c830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Flow 'volume_create_manager' (5465f424-a979-43ae-aa8a-6d6c86731cc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:20 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-f105b51b-e7a5-458d-8d42-f66e1314da23 tempest-VolumesActionsTest-378782857 None] Created volume successfully. Feb 27 02:08:21 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-35039af4-4974-4e0d-9e6f-ae486f7d95d8 tempest-VolumesActionsTest-2040883694 None] Acquiring lock "cinder-d2bd5f1d-17b6-46e0-8467-9d314f630e62-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:21 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-35039af4-4974-4e0d-9e6f-ae486f7d95d8 tempest-VolumesActionsTest-2040883694 None] Lock "cinder-d2bd5f1d-17b6-46e0-8467-9d314f630e62-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:21 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-35039af4-4974-4e0d-9e6f-ae486f7d95d8 tempest-VolumesActionsTest-2040883694 None] Acquiring lock "cinder-quobyte-d2bd5f1d-17b6-46e0-8467-9d314f630e62" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:21 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-35039af4-4974-4e0d-9e6f-ae486f7d95d8 tempest-VolumesActionsTest-2040883694 None] Lock "cinder-quobyte-d2bd5f1d-17b6-46e0-8467-9d314f630e62" acquired by "delete_volume" :: waited 0.016s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:21 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ca75ca-7d89-4d05-a1ce-76af8cc03218]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-35039af4-4974-4e0d-9e6f-ae486f7d95d8 tempest-VolumesActionsTest-2040883694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d2bd5f1d-17b6-46e0-8467-9d314f630e62 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:21 devstack sudo[89049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d2bd5f1d-17b6-46e0-8467-9d314f630e62 Feb 27 02:08:21 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:22 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-35039af4-4974-4e0d-9e6f-ae486f7d95d8 tempest-VolumesActionsTest-2040883694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d2bd5f1d-17b6-46e0-8467-9d314f630e62" returned: 0 in 0.582s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-35039af4-4974-4e0d-9e6f-ae486f7d95d8 tempest-VolumesActionsTest-2040883694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d2bd5f1d-17b6-46e0-8467-9d314f630e62 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:22 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d2bd5f1d-17b6-46e0-8467-9d314f630e62 Feb 27 02:08:22 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:22 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-35039af4-4974-4e0d-9e6f-ae486f7d95d8 tempest-VolumesActionsTest-2040883694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d2bd5f1d-17b6-46e0-8467-9d314f630e62" returned: 0 in 0.512s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-35039af4-4974-4e0d-9e6f-ae486f7d95d8 tempest-VolumesActionsTest-2040883694 None] Lock "cinder-quobyte-d2bd5f1d-17b6-46e0-8467-9d314f630e62" released by "delete_volume" :: held 1.117s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:22 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-35039af4-4974-4e0d-9e6f-ae486f7d95d8 tempest-VolumesActionsTest-2040883694 None] Created reservations ['06df7418-8f76-4d95-871c-d859680c6a88', '7413a0d1-59bb-46c4-be57-587764ec6ad1', '9b43f0c4-a512-4815-985d-11eb1df01410', '1dcf2957-6920-454c-b8d0-2389034dd610'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-35039af4-4974-4e0d-9e6f-ae486f7d95d8 tempest-VolumesActionsTest-2040883694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-35039af4-4974-4e0d-9e6f-ae486f7d95d8 tempest-VolumesActionsTest-2040883694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-35039af4-4974-4e0d-9e6f-ae486f7d95d8 tempest-VolumesActionsTest-2040883694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-35039af4-4974-4e0d-9e6f-ae486f7d95d8 tempest-VolumesActionsTest-2040883694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-35039af4-4974-4e0d-9e6f-ae486f7d95d8 tempest-VolumesActionsTest-2040883694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-35039af4-4974-4e0d-9e6f-ae486f7d95d8 tempest-VolumesActionsTest-2040883694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:22 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:08:22 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:23 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-35039af4-4974-4e0d-9e6f-ae486f7d95d8 tempest-VolumesActionsTest-2040883694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.492s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:23 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-35039af4-4974-4e0d-9e6f-ae486f7d95d8 tempest-VolumesActionsTest-2040883694 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:23 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-35039af4-4974-4e0d-9e6f-ae486f7d95d8 tempest-VolumesActionsTest-2040883694 None] Deleted volume successfully. Feb 27 02:08:23 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-35039af4-4974-4e0d-9e6f-ae486f7d95d8 tempest-VolumesActionsTest-2040883694 None] Lock "cinder-d2bd5f1d-17b6-46e0-8467-9d314f630e62-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Flow 'volume_create_manager' (91b000c5-4ce9-48e1-95d4-ede5e1a19149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a3335a-81a0-4818-90c0-653a65065e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a3335a-81a0-4818-90c0-653a65065e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-145603997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae193e7-3f6f-4158-99c8-b1dc66741592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce005f0fd8a40db8b935f6b322a73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:24Z,use_quota=True,user_id='8a80b48e5d4b4644b70828701f5404f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac3ff525-f576-4e1e-a8c0-cc9fbb577c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac3ff525-f576-4e1e-a8c0-cc9fbb577c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a415cc2c-f360-4cfd-89b7-541a0de15e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a415cc2c-f360-4cfd-89b7-541a0de15e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ae193e7-3f6f-4158-99c8-b1dc66741592', 'volume_name': 'volume-2ae193e7-3f6f-4158-99c8-b1dc66741592', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acbb0a15-8a89-4f0b-9d81-808ae49676de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acbb0a15-8a89-4f0b-9d81-808ae49676de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510a997e-8cb3-422e-880b-9fd578d58e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:24 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Volume 2ae193e7-3f6f-4158-99c8-b1dc66741592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ae193e7-3f6f-4158-99c8-b1dc66741592', 'volume_size': 1} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-145603997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae193e7-3f6f-4158-99c8-b1dc66741592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce005f0fd8a40db8b935f6b322a73e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:24Z,use_quota=True,user_id='8a80b48e5d4b4644b70828701f5404f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Creating volume 2ae193e7-3f6f-4158-99c8-b1dc66741592 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:24 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2ae193e7-3f6f-4158-99c8-b1dc66741592 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:24 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2ae193e7-3f6f-4158-99c8-b1dc66741592 1073741824 Feb 27 02:08:24 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:24 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2ae193e7-3f6f-4158-99c8-b1dc66741592 1073741824" returned: 0 in 0.653s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2ae193e7-3f6f-4158-99c8-b1dc66741592 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:24 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2ae193e7-3f6f-4158-99c8-b1dc66741592 Feb 27 02:08:24 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:25 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2ae193e7-3f6f-4158-99c8-b1dc66741592" returned: 0 in 0.530s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:25 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510a997e-8cb3-422e-880b-9fd578d58e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ae193e7-3f6f-4158-99c8-b1dc66741592', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9e5db3-5831-4662-becd-0906c8611c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:25 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Volume volume-2ae193e7-3f6f-4158-99c8-b1dc66741592 (2ae193e7-3f6f-4158-99c8-b1dc66741592): created successfully Feb 27 02:08:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9e5db3-5831-4662-becd-0906c8611c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Flow 'volume_create_manager' (91b000c5-4ce9-48e1-95d4-ede5e1a19149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:25 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-a693f031-60d4-433b-be6e-52202ec0f801 tempest-VolumesActionsTest-378782857 None] Created volume successfully. Feb 27 02:08:26 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8518cb13-2299-4e80-b0ae-1c1b7f5f63c2 tempest-VolumesActionsTest-378782857 None] Acquiring lock "cinder-2ae193e7-3f6f-4158-99c8-b1dc66741592-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:26 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8518cb13-2299-4e80-b0ae-1c1b7f5f63c2 tempest-VolumesActionsTest-378782857 None] Lock "cinder-2ae193e7-3f6f-4158-99c8-b1dc66741592-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:26 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8518cb13-2299-4e80-b0ae-1c1b7f5f63c2 tempest-VolumesActionsTest-378782857 None] Acquiring lock "cinder-quobyte-2ae193e7-3f6f-4158-99c8-b1dc66741592" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:26 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8518cb13-2299-4e80-b0ae-1c1b7f5f63c2 tempest-VolumesActionsTest-378782857 None] Lock "cinder-quobyte-2ae193e7-3f6f-4158-99c8-b1dc66741592" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:26 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f668ebd5-1d16-4775-a3b0-7526feab587e]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8518cb13-2299-4e80-b0ae-1c1b7f5f63c2 tempest-VolumesActionsTest-378782857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2ae193e7-3f6f-4158-99c8-b1dc66741592 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:26 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2ae193e7-3f6f-4158-99c8-b1dc66741592 Feb 27 02:08:26 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:27 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8518cb13-2299-4e80-b0ae-1c1b7f5f63c2 tempest-VolumesActionsTest-378782857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2ae193e7-3f6f-4158-99c8-b1dc66741592" returned: 0 in 0.618s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8518cb13-2299-4e80-b0ae-1c1b7f5f63c2 tempest-VolumesActionsTest-378782857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2ae193e7-3f6f-4158-99c8-b1dc66741592 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:27 devstack sudo[89075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2ae193e7-3f6f-4158-99c8-b1dc66741592 Feb 27 02:08:27 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:27 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Flow 'volume_create_manager' (239dd49c-f49c-49d2-bd0a-7e7a674ae3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce29dd3a-9340-4c63-9874-081b81d5d180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8518cb13-2299-4e80-b0ae-1c1b7f5f63c2 tempest-VolumesActionsTest-378782857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2ae193e7-3f6f-4158-99c8-b1dc66741592" returned: 0 in 0.527s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce29dd3a-9340-4c63-9874-081b81d5d180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1489596023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a4439f1-b0f2-468e-b996-86b3372d661d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1267c553a083443bbbb37700541a97a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:28Z,use_quota=True,user_id='c759199de00a445a941b425d62cf8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10326316-85f5-43c7-b5f3-1f0e3139e0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10326316-85f5-43c7-b5f3-1f0e3139e0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa6b07e-838e-4ebc-a34d-f04859a5dfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa6b07e-838e-4ebc-a34d-f04859a5dfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a4439f1-b0f2-468e-b996-86b3372d661d', 'volume_name': 'volume-8a4439f1-b0f2-468e-b996-86b3372d661d', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0db117e-38c3-4789-a479-4b88817a6e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0db117e-38c3-4789-a479-4b88817a6e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1094090-80ac-4d9d-83a6-da2d4a154d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:27 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Volume 8a4439f1-b0f2-468e-b996-86b3372d661d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a4439f1-b0f2-468e-b996-86b3372d661d', 'volume_size': 1} Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1489596023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a4439f1-b0f2-468e-b996-86b3372d661d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1267c553a083443bbbb37700541a97a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:28Z,use_quota=True,user_id='c759199de00a445a941b425d62cf8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Creating volume 8a4439f1-b0f2-468e-b996-86b3372d661d {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:27 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:08:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:28 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8518cb13-2299-4e80-b0ae-1c1b7f5f63c2 tempest-VolumesActionsTest-378782857 None] Lock "cinder-quobyte-2ae193e7-3f6f-4158-99c8-b1dc66741592" released by "delete_volume" :: held 1.223s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:28 devstack sudo[89078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d 1073741824 Feb 27 02:08:28 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:28 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-8518cb13-2299-4e80-b0ae-1c1b7f5f63c2 tempest-VolumesActionsTest-378782857 None] Created reservations ['8aeb85e3-2da0-46fd-a747-91734fb3d6b0', '5c870090-b467-4820-ad77-4241b094acf3', '33caa006-3691-4bdd-8b40-abb88b76388c', '04a36a79-ac8d-471c-9f0f-6be6c9744086'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8518cb13-2299-4e80-b0ae-1c1b7f5f63c2 tempest-VolumesActionsTest-378782857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8518cb13-2299-4e80-b0ae-1c1b7f5f63c2 tempest-VolumesActionsTest-378782857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:28 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8518cb13-2299-4e80-b0ae-1c1b7f5f63c2 tempest-VolumesActionsTest-378782857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:28 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8518cb13-2299-4e80-b0ae-1c1b7f5f63c2 tempest-VolumesActionsTest-378782857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8518cb13-2299-4e80-b0ae-1c1b7f5f63c2 tempest-VolumesActionsTest-378782857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8518cb13-2299-4e80-b0ae-1c1b7f5f63c2 tempest-VolumesActionsTest-378782857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:28 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:08:28 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:28 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d 1073741824" returned: 0 in 0.586s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:28 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8518cb13-2299-4e80-b0ae-1c1b7f5f63c2 tempest-VolumesActionsTest-378782857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.488s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:28 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-8518cb13-2299-4e80-b0ae-1c1b7f5f63c2 tempest-VolumesActionsTest-378782857 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:28 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-8518cb13-2299-4e80-b0ae-1c1b7f5f63c2 tempest-VolumesActionsTest-378782857 None] Deleted volume successfully. Feb 27 02:08:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:28 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-8518cb13-2299-4e80-b0ae-1c1b7f5f63c2 tempest-VolumesActionsTest-378782857 None] Lock "cinder-2ae193e7-3f6f-4158-99c8-b1dc66741592-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:28 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d Feb 27 02:08:28 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:29 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d" returned: 0 in 0.465s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:29 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1094090-80ac-4d9d-83a6-da2d4a154d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a4439f1-b0f2-468e-b996-86b3372d661d', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2d7390-2b14-4db6-b59f-1d87a3c3f19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:29 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Volume volume-8a4439f1-b0f2-468e-b996-86b3372d661d (8a4439f1-b0f2-468e-b996-86b3372d661d): created successfully Feb 27 02:08:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2d7390-2b14-4db6-b59f-1d87a3c3f19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Flow 'volume_create_manager' (239dd49c-f49c-49d2-bd0a-7e7a674ae3cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:29 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-d404d025-b0cb-494a-b704-a9d4ece3e13a tempest-VolumesSnapshotTestJSON-841936793 None] Created volume successfully. Feb 27 02:08:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-11202731-41e9-4db4-9b81-4c588587caa7 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-11202731-41e9-4db4-9b81-4c588587caa7 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:30 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-11202731-41e9-4db4-9b81-4c588587caa7 tempest-VolumesSnapshotTestJSON-841936793 None] Creating offline snapshot 32087d04-4b97-4489-9a94-0fad193cf0a9 of volume 8a4439f1-b0f2-468e-b996-86b3372d661d {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:30 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[624ee20a-5ac5-4220-92f1-95efd23494e1]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-11202731-41e9-4db4-9b81-4c588587caa7 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:30 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d Feb 27 02:08:30 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:30 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-11202731-41e9-4db4-9b81-4c588587caa7 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d" returned: 0 in 0.529s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-11202731-41e9-4db4-9b81-4c588587caa7 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.32087d04-4b97-4489-9a94-0fad193cf0a9 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:30 devstack sudo[89096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.32087d04-4b97-4489-9a94-0fad193cf0a9 1G Feb 27 02:08:30 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:31 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-11202731-41e9-4db4-9b81-4c588587caa7 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.32087d04-4b97-4489-9a94-0fad193cf0a9 1G" returned: 0 in 0.591s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-11202731-41e9-4db4-9b81-4c588587caa7 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a4439f1-b0f2-468e-b996-86b3372d661d -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.32087d04-4b97-4489-9a94-0fad193cf0a9 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:31 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a4439f1-b0f2-468e-b996-86b3372d661d -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.32087d04-4b97-4489-9a94-0fad193cf0a9 Feb 27 02:08:31 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:31 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-11202731-41e9-4db4-9b81-4c588587caa7 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a4439f1-b0f2-468e-b996-86b3372d661d -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.32087d04-4b97-4489-9a94-0fad193cf0a9" returned: 0 in 0.534s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:31 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-11202731-41e9-4db4-9b81-4c588587caa7 tempest-VolumesSnapshotTestJSON-841936793 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.32087d04-4b97-4489-9a94-0fad193cf0a9 is being set with open permissions: ugo+rw Feb 27 02:08:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-11202731-41e9-4db4-9b81-4c588587caa7 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.32087d04-4b97-4489-9a94-0fad193cf0a9 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:31 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.32087d04-4b97-4489-9a94-0fad193cf0a9 Feb 27 02:08:31 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:32 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-11202731-41e9-4db4-9b81-4c588587caa7 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.32087d04-4b97-4489-9a94-0fad193cf0a9" returned: 0 in 0.520s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-11202731-41e9-4db4-9b81-4c588587caa7 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:32 devstack sudo[89110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.info Feb 27 02:08:32 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:32 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-11202731-41e9-4db4-9b81-4c588587caa7 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.info" returned: 0 in 0.500s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:32 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-11202731-41e9-4db4-9b81-4c588587caa7 tempest-VolumesSnapshotTestJSON-841936793 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.info is being set with open permissions: ugo+rw Feb 27 02:08:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-11202731-41e9-4db4-9b81-4c588587caa7 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:33 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.info Feb 27 02:08:33 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:33 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-11202731-41e9-4db4-9b81-4c588587caa7 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.info" returned: 0 in 0.580s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-11202731-41e9-4db4-9b81-4c588587caa7 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.330s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:33 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-11202731-41e9-4db4-9b81-4c588587caa7 tempest-VolumesSnapshotTestJSON-841936793 None] Create snapshot completed successfully Feb 27 02:08:34 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-32087d04-4b97-4489-9a94-0fad193cf0a9-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:34 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-32087d04-4b97-4489-9a94-0fad193cf0a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:34 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-quobyte-8a4439f1-b0f2-468e-b996-86b3372d661d" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:34 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-8a4439f1-b0f2-468e-b996-86b3372d661d" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:34 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-quobyte-32087d04-4b97-4489-9a94-0fad193cf0a9" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:34 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-32087d04-4b97-4489-9a94-0fad193cf0a9" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:34 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] Deleting offline snapshot 32087d04-4b97-4489-9a94-0fad193cf0a9 of volume 8a4439f1-b0f2-468e-b996-86b3372d661d {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:08:34 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] snapshot_file for this snap is: volume-8a4439f1-b0f2-468e-b996-86b3372d661d.32087d04-4b97-4489-9a94-0fad193cf0a9 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:08:34 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8862e7-3d4d-4e00-a42e-c50c8a7d8abd]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.32087d04-4b97-4489-9a94-0fad193cf0a9 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:35 devstack sudo[89117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.32087d04-4b97-4489-9a94-0fad193cf0a9 Feb 27 02:08:35 devstack sudo[89117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:35 devstack sudo[89117]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.32087d04-4b97-4489-9a94-0fad193cf0a9" returned: 0 in 0.602s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:35 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a4439f1-b0f2-468e-b996-86b3372d661d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:35 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[184e989e-f7b1-4197-8816-0670c14ac309]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:35 devstack sudo[89123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d Feb 27 02:08:35 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:36 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d" returned: 0 in 0.574s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.32087d04-4b97-4489-9a94-0fad193cf0a9 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:36 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.32087d04-4b97-4489-9a94-0fad193cf0a9 Feb 27 02:08:36 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:36 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.32087d04-4b97-4489-9a94-0fad193cf0a9" returned: 0 in 0.587s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.32087d04-4b97-4489-9a94-0fad193cf0a9 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:36 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.32087d04-4b97-4489-9a94-0fad193cf0a9 Feb 27 02:08:36 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:37 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d.32087d04-4b97-4489-9a94-0fad193cf0a9" returned: 0 in 0.541s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:37 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-32087d04-4b97-4489-9a94-0fad193cf0a9" released by "_delete_snapshot" :: held 2.387s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:37 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-8a4439f1-b0f2-468e-b996-86b3372d661d" released by "delete_snapshot" :: held 2.402s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:37 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] Created reservations ['4b12994a-ecee-4593-a861-66792468c35b', 'b37cc5a8-2eb3-4ee6-94a9-c827bf8c6e52', 'd8e1ada3-86ca-4bf1-9ad3-c4e47f61224f', 'd18a9ad6-9569-4f46-b411-0c91fff71d7e'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:37 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] Delete snapshot completed successfully. Feb 27 02:08:37 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6ce81f4b-29df-4b3e-8738-82a8d97b0094 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-32087d04-4b97-4489-9a94-0fad193cf0a9-delete_snapshot" released by "delete_snapshot" :: held 2.547s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Flow 'volume_create_manager' (b2c659fb-78ba-4a2d-ba9a-fae1fd00c136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391cb341-cf11-4053-ae8b-83bdba4911cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391cb341-cf11-4053-ae8b-83bdba4911cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-8226710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b5b16d-57df-47ac-933d-ff35fbc242eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc9d78fb715462b9e0b081f27607e58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:38Z,use_quota=True,user_id='8b56c828a0e84eb995eeeb3d1bea7725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8b765e-6246-4bbd-a151-1f4b2cb167f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8b765e-6246-4bbd-a151-1f4b2cb167f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9fb532-e8cd-4e78-ac47-689945883e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.image.glance [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Creating Keystone auth plugin from conf {{(pid=82683) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9fb532-e8cd-4e78-ac47-689945883e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '73b5b16d-57df-47ac-933d-ff35fbc242eb', 'volume_name': 'volume-73b5b16d-57df-47ac-933d-ff35fbc242eb', 'volume_size': 1, 'image_id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '757f43b353254b8d946a078a47db0c70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1936e0bd-39f5-48aa-82e1-d79c80c86062/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d841c3de-dd7a-439c-9152-52b22f684da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d841c3de-dd7a-439c-9152-52b22f684da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961eb348-fe0b-472b-8de8-4a459ff382a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:38 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Volume 73b5b16d-57df-47ac-933d-ff35fbc242eb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-73b5b16d-57df-47ac-933d-ff35fbc242eb', 'volume_size': 1, 'image_id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '757f43b353254b8d946a078a47db0c70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1936e0bd-39f5-48aa-82e1-d79c80c86062/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Trying to clone 73b5b16d-57df-47ac-933d-ff35fbc242eb from image 1936e0bd-39f5-48aa-82e1-d79c80c86062 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}]). {{(pid=82683) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Flow 'volume_create_manager' (cbc04237-0a25-4799-83b6-0d58f760be0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1876ef-683e-4583-a6fb-5c2f88033add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1876ef-683e-4583-a6fb-5c2f88033add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1598051110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7758a0f9-b549-4b54-8ba8-dc1d81d47f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1267c553a083443bbbb37700541a97a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:38Z,use_quota=True,user_id='c759199de00a445a941b425d62cf8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d851492-d296-4b40-9611-69531023f583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d851492-d296-4b40-9611-69531023f583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (653fa6e0-0048-4543-aa15-9da7c73eea78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (653fa6e0-0048-4543-aa15-9da7c73eea78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7758a0f9-b549-4b54-8ba8-dc1d81d47f09', 'volume_name': 'volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490afea9-ff12-4b95-a8e5-5c93c2dd0a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490afea9-ff12-4b95-a8e5-5c93c2dd0a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ebaca6-a3b8-46e9-84a4-0e8dee094cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:38 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Volume 7758a0f9-b549-4b54-8ba8-dc1d81d47f09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09', 'volume_size': 1} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1598051110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7758a0f9-b549-4b54-8ba8-dc1d81d47f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1267c553a083443bbbb37700541a97a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:38Z,use_quota=True,user_id='c759199de00a445a941b425d62cf8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Creating volume 7758a0f9-b549-4b54-8ba8-dc1d81d47f09 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:38 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:38 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 1073741824 Feb 27 02:08:38 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_ey1uggsddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82683) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 27 02:08:38 devstack cinder-volume[82683]: INFO cinder.image.image_utils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Image download 20.69 MB at 20.69 MB/s Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2997e2c-a234-4bff-8fcc-a2dc7cebf11e]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_ey1uggsddevstack@QuobyteHD {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:38 devstack sudo[89142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_ey1uggsddevstack@QuobyteHD Feb 27 02:08:38 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:39 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 1073741824" returned: 0 in 0.590s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:39 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 Feb 27 02:08:39 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:39 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_ey1uggsddevstack@QuobyteHD" returned: 0 in 0.529s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Temporary image 1936e0bd-39f5-48aa-82e1-d79c80c86062 is fetched for user 8b56c828a0e84eb995eeeb3d1bea7725. {{(pid=82683) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e229268-dc3a-4bff-8839-52e363147553]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_ey1uggsddevstack@QuobyteHD {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:39 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_ey1uggsddevstack@QuobyteHD Feb 27 02:08:39 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:39 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09" returned: 0 in 0.484s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ebaca6-a3b8-46e9-84a4-0e8dee094cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c08461-f9c2-4fea-8322-7f87682a927d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:39 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Volume volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 (7758a0f9-b549-4b54-8ba8-dc1d81d47f09): created successfully Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2c08461-f9c2-4fea-8322-7f87682a927d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Flow 'volume_create_manager' (cbc04237-0a25-4799-83b6-0d58f760be0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:39 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-473f979c-f8a4-4c10-834c-4d72ad450767 tempest-VolumesSnapshotTestJSON-841936793 None] Created volume successfully. Feb 27 02:08:39 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_ey1uggsddevstack@QuobyteHD" returned: 0 in 0.532s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-8226710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b5b16d-57df-47ac-933d-ff35fbc242eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc9d78fb715462b9e0b081f27607e58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:38Z,use_quota=True,user_id='8b56c828a0e84eb995eeeb3d1bea7725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Creating volume 73b5b16d-57df-47ac-933d-ff35fbc242eb {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:39 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:08:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:39 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb 1073741824 Feb 27 02:08:39 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:40 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb 1073741824" returned: 0 in 0.583s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:40 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb Feb 27 02:08:40 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5c2864df-cad9-4418-acc8-4ee56f4e3583 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:40 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb" returned: 0 in 0.495s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:40 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5c2864df-cad9-4418-acc8-4ee56f4e3583 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.236s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:40 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-5c2864df-cad9-4418-acc8-4ee56f4e3583 tempest-VolumesSnapshotTestJSON-841936793 None] Creating offline snapshot 29c1c6a9-12d1-4c58-a2ae-1cb313451f1e of volume 7758a0f9-b549-4b54-8ba8-dc1d81d47f09 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:08:40 devstack cinder-volume[82683]: DEBUG cinder.volume.volume_utils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Attempting download of 1936e0bd-39f5-48aa-82e1-d79c80c86062 ((None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}])) to volume 73b5b16d-57df-47ac-933d-ff35fbc242eb. {{(pid=82683) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 27 02:08:40 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea9df1f-9d8f-4b33-bdfa-cbd7ab0087e8]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5c2864df-cad9-4418-acc8-4ee56f4e3583 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:41 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad537a17-4fc6-4704-9208-d0b10d022fc6]: (4, 'raw') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_2wwco20k {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:41 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 Feb 27 02:08:41 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:41 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_2wwco20k Feb 27 02:08:41 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:41 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_2wwco20k" returned: 0 in 0.487s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_2wwco20k {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:41 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5c2864df-cad9-4418-acc8-4ee56f4e3583 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09" returned: 0 in 0.562s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5c2864df-cad9-4418-acc8-4ee56f4e3583 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:41 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e 1G Feb 27 02:08:41 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:41 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_2wwco20k Feb 27 02:08:41 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:41 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_2wwco20k" returned: 1 in 0.477s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1936e0bd-39f5-48aa-82e1-d79c80c86062_2wwco20k' failed. Not Retrying. {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:08:41 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7291d3e-2349-411e-bcfc-6ee4c43ef7c4]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_ey1uggsddevstack@QuobyteHD {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:42 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5c2864df-cad9-4418-acc8-4ee56f4e3583 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e 1G" returned: 0 in 0.512s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5c2864df-cad9-4418-acc8-4ee56f4e3583 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:42 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_ey1uggsddevstack@QuobyteHD Feb 27 02:08:42 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:42 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e Feb 27 02:08:42 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:42 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_ey1uggsddevstack@QuobyteHD" returned: 0 in 0.555s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:42 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] 1936e0bd-39f5-48aa-82e1-d79c80c86062 was qcow2, converting to raw {{(pid=82683) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 27 02:08:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_ey1uggsddevstack@QuobyteHD /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:42 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_ey1uggsddevstack@QuobyteHD /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb Feb 27 02:08:42 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:42 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5c2864df-cad9-4418-acc8-4ee56f4e3583 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e" returned: 0 in 0.526s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:42 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-5c2864df-cad9-4418-acc8-4ee56f4e3583 tempest-VolumesSnapshotTestJSON-841936793 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e is being set with open permissions: ugo+rw Feb 27 02:08:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5c2864df-cad9-4418-acc8-4ee56f4e3583 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:42 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e Feb 27 02:08:42 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:43 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5c2864df-cad9-4418-acc8-4ee56f4e3583 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e" returned: 0 in 0.527s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5c2864df-cad9-4418-acc8-4ee56f4e3583 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:43 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.info Feb 27 02:08:43 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:43 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5c2864df-cad9-4418-acc8-4ee56f4e3583 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.info" returned: 0 in 0.476s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:43 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-5c2864df-cad9-4418-acc8-4ee56f4e3583 tempest-VolumesSnapshotTestJSON-841936793 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.info is being set with open permissions: ugo+rw Feb 27 02:08:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5c2864df-cad9-4418-acc8-4ee56f4e3583 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:43 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.info Feb 27 02:08:43 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:43 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_ey1uggsddevstack@QuobyteHD /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb" returned: 0 in 1.188s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:43 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1936e0bd-39f5-48aa-82e1-d79c80c86062_ey1uggsddevstack@QuobyteHD, size 112.00 MB, duration 1.19 sec, destination /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb {{(pid=82683) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:08:43 devstack cinder-volume[82683]: INFO cinder.image.image_utils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Converted 112.00 MB image at 94.16 MB/s Feb 27 02:08:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:43 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb 1G Feb 27 02:08:43 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:44 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5c2864df-cad9-4418-acc8-4ee56f4e3583 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.info" returned: 0 in 0.436s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5c2864df-cad9-4418-acc8-4ee56f4e3583 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.106s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:44 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-5c2864df-cad9-4418-acc8-4ee56f4e3583 tempest-VolumesSnapshotTestJSON-841936793 None] Create snapshot completed successfully Feb 27 02:08:44 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb 1G" returned: 0 in 0.492s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:44 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c07d0dd-0a13-46ba-94c2-ed3db3d63a5f]: (4, 'raw') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:44 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb Feb 27 02:08:44 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:44 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb" returned: 0 in 0.485s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:44 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb Feb 27 02:08:44 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Flow 'volume_create_manager' (922c1e74-ea1e-4f9b-80d7-a9bfe25e5934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e7c37c-42a8-4c61-9589-5911bd2e6ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e7c37c-42a8-4c61-9589-5911bd2e6ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1355181683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a14705a-37bb-453d-aa0f-2dc89c70c49b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1267c553a083443bbbb37700541a97a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=29c1c6a9-12d1-4c58-a2ae-1cb313451f1e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:45Z,use_quota=True,user_id='c759199de00a445a941b425d62cf8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011c3a5f-6c01-4e00-affc-43dfe8de1faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011c3a5f-6c01-4e00-affc-43dfe8de1faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca35d38-c727-4a4c-b4e1-0ec770b10aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca35d38-c727-4a4c-b4e1-0ec770b10aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2a14705a-37bb-453d-aa0f-2dc89c70c49b', 'volume_name': 'volume-2a14705a-37bb-453d-aa0f-2dc89c70c49b', 'volume_size': 2, 'snapshot_id': '29c1c6a9-12d1-4c58-a2ae-1cb313451f1e'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87eb486-d7e6-4b27-beaf-d285f36da34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:45 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87eb486-d7e6-4b27-beaf-d285f36da34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546f731b-dec8-4772-8c21-9807e089440b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:45 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Volume 2a14705a-37bb-453d-aa0f-2dc89c70c49b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2a14705a-37bb-453d-aa0f-2dc89c70c49b', 'volume_size': 2, 'snapshot_id': '29c1c6a9-12d1-4c58-a2ae-1cb313451f1e'} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb" returned: 1 in 0.604s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb' failed. Not Retrying. {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.volume_utils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Downloaded image 1936e0bd-39f5-48aa-82e1-d79c80c86062 ((None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}])) to volume 73b5b16d-57df-47ac-933d-ff35fbc242eb successfully. {{(pid=82683) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Temporary image 1936e0bd-39f5-48aa-82e1-d79c80c86062 for user 8b56c828a0e84eb995eeeb3d1bea7725 is deleted. {{(pid=82683) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.volume_utils [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Marking volume 73b5b16d-57df-47ac-933d-ff35fbc242eb as bootable. {{(pid=82683) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-quobyte-29c1c6a9-12d1-4c58-a2ae-1cb313451f1e-2a14705a-37bb-453d-aa0f-2dc89c70c49b" by "_create_volume_from_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Copying metadata from image 1936e0bd-39f5-48aa-82e1-d79c80c86062 to 73b5b16d-57df-47ac-933d-ff35fbc242eb. {{(pid=82683) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Creating volume glance metadata for volume 73b5b16d-57df-47ac-933d-ff35fbc242eb backed by image 1936e0bd-39f5-48aa-82e1-d79c80c86062 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82683) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-29c1c6a9-12d1-4c58-a2ae-1cb313451f1e-2a14705a-37bb-453d-aa0f-2dc89c70c49b" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Creating volume 2a14705a-37bb-453d-aa0f-2dc89c70c49b from snapshot 29c1c6a9-12d1-4c58-a2ae-1cb313451f1e {{(pid=82683) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-quobyte-2a14705a-37bb-453d-aa0f-2dc89c70c49b" by "_copy_volume_from_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-2a14705a-37bb-453d-aa0f-2dc89c70c49b" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] snapshot: 29c1c6a9-12d1-4c58-a2ae-1cb313451f1e, volume: 2a14705a-37bb-453d-aa0f-2dc89c70c49b, {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4837996a-fd38-498e-a9c5-7c2fdad3d39a]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961eb348-fe0b-472b-8de8-4a459ff382a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b5b16d-57df-47ac-933d-ff35fbc242eb', 'volume_size': 1, 'image_id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1936e0bd-39f5-48aa-82e1-d79c80c86062', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '757f43b353254b8d946a078a47db0c70', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1936e0bd-39f5-48aa-82e1-d79c80c86062', 'created_at': datetime.datetime(2026, 2, 27, 0, 56, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 27, 0, 56, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1936e0bd-39f5-48aa-82e1-d79c80c86062/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340ad77e-aa40-45b7-ad20-6d1136790e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:45 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Volume volume-73b5b16d-57df-47ac-933d-ff35fbc242eb (73b5b16d-57df-47ac-933d-ff35fbc242eb): created successfully Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340ad77e-aa40-45b7-ad20-6d1136790e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Flow 'volume_create_manager' (b2c659fb-78ba-4a2d-ba9a-fae1fd00c136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:45 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-bc30a5f6-ffd5-4d59-bff3-7a3bf80b9fe2 tempest-VolumesImageMetadata-2048271174 None] Created volume successfully. Feb 27 02:08:45 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e Feb 27 02:08:45 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:46 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e" returned: 0 in 0.561s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] will copy from snapshot at /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:08:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Creating direct copy from snapshot {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:08:46 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ede9bf0-5957-4671-9a8e-6654abf6618b]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:46 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 Feb 27 02:08:46 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:46 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09" returned: 0 in 0.596s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:46 devstack cinder-volume[82683]: DEBUG cinder.utils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Path /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2a14705a-37bb-453d-aa0f-2dc89c70c49b not found in is_blk_device check {{(pid=82683) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:08:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2a14705a-37bb-453d-aa0f-2dc89c70c49b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:46 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2a14705a-37bb-453d-aa0f-2dc89c70c49b Feb 27 02:08:46 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:46 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] Acquiring lock "cinder-73b5b16d-57df-47ac-933d-ff35fbc242eb-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:46 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] Lock "cinder-73b5b16d-57df-47ac-933d-ff35fbc242eb-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:46 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] Acquiring lock "cinder-quobyte-73b5b16d-57df-47ac-933d-ff35fbc242eb" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:46 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] Lock "cinder-quobyte-73b5b16d-57df-47ac-933d-ff35fbc242eb" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:46 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efb5186-6c77-4827-a57d-fbd120fca6c2]: (4, 'raw') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:46 devstack sudo[89245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb Feb 27 02:08:46 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:47 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb" returned: 0 in 0.632s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:47 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb Feb 27 02:08:47 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:49 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb" returned: 1 in 1.594s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb' failed. Not Retrying. {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 27 02:08:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:49 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb Feb 27 02:08:49 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:49 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2a14705a-37bb-453d-aa0f-2dc89c70c49b" returned: 0 in 2.524s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:49 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bc6dda-ace8-418d-b3b1-a1dc575359d4]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:49 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 Feb 27 02:08:49 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:49 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-73b5b16d-57df-47ac-933d-ff35fbc242eb" returned: 0 in 0.474s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:49 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] Lock "cinder-quobyte-73b5b16d-57df-47ac-933d-ff35fbc242eb" released by "delete_volume" :: held 2.764s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:49 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] Created reservations ['c916cb73-a0ed-4a9f-8465-54bf637183b2', '45fdb64c-b718-4a26-af5b-df3e43dc33ea', '29fc3f41-5d9f-4669-a8ad-3af1bd869c58', 'c2924f07-eb4f-4b9e-ad47-26bc7957aa93'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:49 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:08:49 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:49 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09" returned: 0 in 0.703s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:49 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Image conversion details: src /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09, size 1024.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2a14705a-37bb-453d-aa0f-2dc89c70c49b {{(pid=82683) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:08:49 devstack cinder-volume[82683]: INFO cinder.image.image_utils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Converted 1024.00 MB image at 405.37 MB/s Feb 27 02:08:49 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2a14705a-37bb-453d-aa0f-2dc89c70c49b is being set with open permissions: ugo+rw Feb 27 02:08:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2a14705a-37bb-453d-aa0f-2dc89c70c49b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:49 devstack sudo[89275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2a14705a-37bb-453d-aa0f-2dc89c70c49b Feb 27 02:08:49 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:50 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.453s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:50 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:50 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] Deleted volume successfully. Feb 27 02:08:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a40230ad-6719-47b3-94b1-310bc0793926 tempest-VolumesImageMetadata-2048271174 None] Lock "cinder-73b5b16d-57df-47ac-933d-ff35fbc242eb-delete_volume" released by "delete_volume" :: held 3.380s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:50 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2a14705a-37bb-453d-aa0f-2dc89c70c49b" returned: 0 in 0.540s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-2a14705a-37bb-453d-aa0f-2dc89c70c49b" released by "_copy_volume_from_snapshot" :: held 5.000s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-29c1c6a9-12d1-4c58-a2ae-1cb313451f1e-2a14705a-37bb-453d-aa0f-2dc89c70c49b" released by "_create_volume_from_snapshot" :: held 5.022s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.040s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546f731b-dec8-4772-8c21-9807e089440b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a14705a-37bb-453d-aa0f-2dc89c70c49b', 'volume_size': 2, 'snapshot_id': '29c1c6a9-12d1-4c58-a2ae-1cb313451f1e'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e315cd0-c765-42ca-ad57-866b28d99126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:50 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Volume volume-2a14705a-37bb-453d-aa0f-2dc89c70c49b (2a14705a-37bb-453d-aa0f-2dc89c70c49b): created successfully Feb 27 02:08:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e315cd0-c765-42ca-ad57-866b28d99126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Flow 'volume_create_manager' (922c1e74-ea1e-4f9b-80d7-a9bfe25e5934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:50 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-ce03d78d-964b-473d-a74a-126810c8c06a tempest-VolumesSnapshotTestJSON-841936793 None] Created volume successfully. Feb 27 02:08:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-75f15863-0bf7-4aa8-9b92-11203462b4c5 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-2a14705a-37bb-453d-aa0f-2dc89c70c49b-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-75f15863-0bf7-4aa8-9b92-11203462b4c5 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-2a14705a-37bb-453d-aa0f-2dc89c70c49b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-75f15863-0bf7-4aa8-9b92-11203462b4c5 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-quobyte-2a14705a-37bb-453d-aa0f-2dc89c70c49b" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-75f15863-0bf7-4aa8-9b92-11203462b4c5 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-2a14705a-37bb-453d-aa0f-2dc89c70c49b" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:50 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a86016b-47c4-44f4-9470-99215dda91cc]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-75f15863-0bf7-4aa8-9b92-11203462b4c5 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2a14705a-37bb-453d-aa0f-2dc89c70c49b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:50 devstack sudo[89279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2a14705a-37bb-453d-aa0f-2dc89c70c49b Feb 27 02:08:50 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:51 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-75f15863-0bf7-4aa8-9b92-11203462b4c5 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2a14705a-37bb-453d-aa0f-2dc89c70c49b" returned: 0 in 0.661s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-75f15863-0bf7-4aa8-9b92-11203462b4c5 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2a14705a-37bb-453d-aa0f-2dc89c70c49b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:51 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2a14705a-37bb-453d-aa0f-2dc89c70c49b Feb 27 02:08:51 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:52 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-75f15863-0bf7-4aa8-9b92-11203462b4c5 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2a14705a-37bb-453d-aa0f-2dc89c70c49b" returned: 0 in 0.528s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-75f15863-0bf7-4aa8-9b92-11203462b4c5 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-2a14705a-37bb-453d-aa0f-2dc89c70c49b" released by "delete_volume" :: held 1.217s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:52 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-75f15863-0bf7-4aa8-9b92-11203462b4c5 tempest-VolumesSnapshotTestJSON-841936793 None] Created reservations ['c950794d-722e-48b2-8d49-b20f50264e87', 'c5e8a7bf-80b7-48d6-8cfb-74d991ad9d44', 'c64ed757-21f8-4b1f-86d8-456a7c5979f7', '1a7fed74-cb10-4c37-a992-e8684971fffc'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-75f15863-0bf7-4aa8-9b92-11203462b4c5 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-75f15863-0bf7-4aa8-9b92-11203462b4c5 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:52 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-75f15863-0bf7-4aa8-9b92-11203462b4c5 tempest-VolumesSnapshotTestJSON-841936793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:52 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-75f15863-0bf7-4aa8-9b92-11203462b4c5 tempest-VolumesSnapshotTestJSON-841936793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-75f15863-0bf7-4aa8-9b92-11203462b4c5 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-75f15863-0bf7-4aa8-9b92-11203462b4c5 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:52 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:08:52 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:52 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-75f15863-0bf7-4aa8-9b92-11203462b4c5 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.496s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:52 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-75f15863-0bf7-4aa8-9b92-11203462b4c5 tempest-VolumesSnapshotTestJSON-841936793 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:52 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-75f15863-0bf7-4aa8-9b92-11203462b4c5 tempest-VolumesSnapshotTestJSON-841936793 None] Deleted volume successfully. Feb 27 02:08:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-75f15863-0bf7-4aa8-9b92-11203462b4c5 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-2a14705a-37bb-453d-aa0f-2dc89c70c49b-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-29c1c6a9-12d1-4c58-a2ae-1cb313451f1e-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-29c1c6a9-12d1-4c58-a2ae-1cb313451f1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-quobyte-7758a0f9-b549-4b54-8ba8-dc1d81d47f09" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-7758a0f9-b549-4b54-8ba8-dc1d81d47f09" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-quobyte-29c1c6a9-12d1-4c58-a2ae-1cb313451f1e" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-29c1c6a9-12d1-4c58-a2ae-1cb313451f1e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:53 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] Deleting offline snapshot 29c1c6a9-12d1-4c58-a2ae-1cb313451f1e of volume 7758a0f9-b549-4b54-8ba8-dc1d81d47f09 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:08:53 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] snapshot_file for this snap is: volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:08:53 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[042ade15-9685-4cfb-a193-567bd934692c]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:53 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e Feb 27 02:08:53 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:53 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e" returned: 0 in 0.582s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:53 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:08:53 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7de7cfa-b05b-4966-bab5-9ff66c997706]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:53 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 Feb 27 02:08:53 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:54 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09" returned: 0 in 0.546s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:54 devstack sudo[89300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e Feb 27 02:08:54 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:54 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e" returned: 0 in 0.542s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:54 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e Feb 27 02:08:54 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:55 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Flow 'volume_create_manager' (fd59dddb-b3a5-48f5-b840-247b933ff44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7060d289-d318-482c-b729-9b8a568dfc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09.29c1c6a9-12d1-4c58-a2ae-1cb313451f1e" returned: 0 in 0.495s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7060d289-d318-482c-b729-9b8a568dfc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1793214966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968ab21c-0d52-4f08-9e94-738c2860402c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9623a6894b4bcdb987d0d9acb02a73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:55Z,use_quota=True,user_id='7cc9cf7fa9554460b0a4ec994ae6399c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3d3004-beab-4130-8890-5470ae7e2745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3d3004-beab-4130-8890-5470ae7e2745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e8172a-38bb-49bc-937c-4effa65f7fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e8172a-38bb-49bc-937c-4effa65f7fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '968ab21c-0d52-4f08-9e94-738c2860402c', 'volume_name': 'volume-968ab21c-0d52-4f08-9e94-738c2860402c', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3fbf6bb-4e3c-4718-9bdf-fadd9234898b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3fbf6bb-4e3c-4718-9bdf-fadd9234898b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07518cb9-ac43-4a9f-b55d-43d20589977e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:55 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Volume 968ab21c-0d52-4f08-9e94-738c2860402c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-968ab21c-0d52-4f08-9e94-738c2860402c', 'volume_size': 1} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1793214966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968ab21c-0d52-4f08-9e94-738c2860402c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9623a6894b4bcdb987d0d9acb02a73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:55Z,use_quota=True,user_id='7cc9cf7fa9554460b0a4ec994ae6399c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Creating volume 968ab21c-0d52-4f08-9e94-738c2860402c {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:55 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-968ab21c-0d52-4f08-9e94-738c2860402c 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-29c1c6a9-12d1-4c58-a2ae-1cb313451f1e" released by "_delete_snapshot" :: held 2.277s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-7758a0f9-b549-4b54-8ba8-dc1d81d47f09" released by "delete_snapshot" :: held 2.297s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:55 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-968ab21c-0d52-4f08-9e94-738c2860402c 1073741824 Feb 27 02:08:55 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] Created reservations ['173f8784-c6da-4e77-be02-ea05e00f08e2', 'cbce974d-f5b1-4abc-bde9-dc1aadc70ec0', 'd14393f7-f5d0-42d1-b8cd-01de12a7607c', '4cb95415-e6ac-447b-8198-97e5670417a9'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:55 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] Delete snapshot completed successfully. Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1f2ccc39-8bd6-48fc-a399-50099d746845 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-29c1c6a9-12d1-4c58-a2ae-1cb313451f1e-delete_snapshot" released by "delete_snapshot" :: held 2.389s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:55 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-968ab21c-0d52-4f08-9e94-738c2860402c 1073741824" returned: 0 in 0.563s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-968ab21c-0d52-4f08-9e94-738c2860402c {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:56 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-968ab21c-0d52-4f08-9e94-738c2860402c Feb 27 02:08:56 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bbd7ac97-1aaf-45e5-aab8-981aded7613a tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-7758a0f9-b549-4b54-8ba8-dc1d81d47f09-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bbd7ac97-1aaf-45e5-aab8-981aded7613a tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-7758a0f9-b549-4b54-8ba8-dc1d81d47f09-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bbd7ac97-1aaf-45e5-aab8-981aded7613a tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-quobyte-7758a0f9-b549-4b54-8ba8-dc1d81d47f09" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bbd7ac97-1aaf-45e5-aab8-981aded7613a tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-7758a0f9-b549-4b54-8ba8-dc1d81d47f09" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:56 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ffe73e-ad4f-408c-a37e-2c6e8faaca23]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bbd7ac97-1aaf-45e5-aab8-981aded7613a tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:56 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-968ab21c-0d52-4f08-9e94-738c2860402c" returned: 0 in 0.508s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07518cb9-ac43-4a9f-b55d-43d20589977e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-968ab21c-0d52-4f08-9e94-738c2860402c', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47deeff5-dc76-4009-88ba-80a119c4108a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:56 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Volume volume-968ab21c-0d52-4f08-9e94-738c2860402c (968ab21c-0d52-4f08-9e94-738c2860402c): created successfully Feb 27 02:08:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47deeff5-dc76-4009-88ba-80a119c4108a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Flow 'volume_create_manager' (fd59dddb-b3a5-48f5-b840-247b933ff44a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:56 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 Feb 27 02:08:56 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:56 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-2775efda-35f5-423e-b91a-b5fb4cf4e80f tempest-VolumesTransfersTest-2132905573 None] Created volume successfully. Feb 27 02:08:56 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bbd7ac97-1aaf-45e5-aab8-981aded7613a tempest-VolumesSnapshotTestJSON-841936793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09" returned: 0 in 0.499s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bbd7ac97-1aaf-45e5-aab8-981aded7613a tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:56 devstack sudo[89321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09 Feb 27 02:08:56 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:57 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bbd7ac97-1aaf-45e5-aab8-981aded7613a tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7758a0f9-b549-4b54-8ba8-dc1d81d47f09" returned: 0 in 0.439s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bbd7ac97-1aaf-45e5-aab8-981aded7613a tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-7758a0f9-b549-4b54-8ba8-dc1d81d47f09" released by "delete_volume" :: held 0.973s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-bbd7ac97-1aaf-45e5-aab8-981aded7613a tempest-VolumesSnapshotTestJSON-841936793 None] Created reservations ['201bf4cd-61bf-4082-9ffd-5ad42691b9d6', 'd754b030-e82f-492d-ba89-196f2bef19d5', 'f3f065e7-375f-4960-8f36-938446eabeec', 'ec12412e-f586-4812-bb8c-829bfef0a659'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bbd7ac97-1aaf-45e5-aab8-981aded7613a tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bbd7ac97-1aaf-45e5-aab8-981aded7613a tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-bbd7ac97-1aaf-45e5-aab8-981aded7613a tempest-VolumesSnapshotTestJSON-841936793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-bbd7ac97-1aaf-45e5-aab8-981aded7613a tempest-VolumesSnapshotTestJSON-841936793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bbd7ac97-1aaf-45e5-aab8-981aded7613a tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bbd7ac97-1aaf-45e5-aab8-981aded7613a tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:57 devstack sudo[89324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:08:57 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Flow 'volume_create_manager' (e1328cf8-3e9b-44c9-9c7b-6aedbc941551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (532dfe1a-1259-4bfb-8f62-06c6fb72e2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (532dfe1a-1259-4bfb-8f62-06c6fb72e2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1426382947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f0e9fb-ddb9-4499-bea5-5aa06d3440a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1267c553a083443bbbb37700541a97a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:58Z,use_quota=True,user_id='c759199de00a445a941b425d62cf8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80221714-23ba-413f-b87f-4c9686c83bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80221714-23ba-413f-b87f-4c9686c83bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b147f29f-4d03-45a6-8311-70abcd34cbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b147f29f-4d03-45a6-8311-70abcd34cbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08f0e9fb-ddb9-4499-bea5-5aa06d3440a6', 'volume_name': 'volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325c3696-0121-4f04-b412-e0d111d56dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325c3696-0121-4f04-b412-e0d111d56dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1421183-de8a-4ebb-829c-83a99395940e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:57 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Volume 08f0e9fb-ddb9-4499-bea5-5aa06d3440a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6', 'volume_size': 1} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1426382947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f0e9fb-ddb9-4499-bea5-5aa06d3440a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1267c553a083443bbbb37700541a97a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:08:58Z,use_quota=True,user_id='c759199de00a445a941b425d62cf8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Creating volume 08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:08:57 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:08:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:57 devstack sudo[89326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 1073741824 Feb 27 02:08:57 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:58 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-969b21b6-fe28-48d2-abf4-4318e4dc0918 tempest-VolumesTransfersTest-1336011800 None] Transfer volume completed successfully. Feb 27 02:08:58 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bbd7ac97-1aaf-45e5-aab8-981aded7613a tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.576s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:58 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-bbd7ac97-1aaf-45e5-aab8-981aded7613a tempest-VolumesSnapshotTestJSON-841936793 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:08:58 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-bbd7ac97-1aaf-45e5-aab8-981aded7613a tempest-VolumesSnapshotTestJSON-841936793 None] Deleted volume successfully. Feb 27 02:08:58 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bbd7ac97-1aaf-45e5-aab8-981aded7613a tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-7758a0f9-b549-4b54-8ba8-dc1d81d47f09-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:08:58 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 1073741824" returned: 0 in 0.550s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:58 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 Feb 27 02:08:58 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:58 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d56a77e7-39c8-4575-9dbc-aabc16f70350 tempest-VolumesTransfersTest-1795466568 None] Acquiring lock "cinder-968ab21c-0d52-4f08-9e94-738c2860402c-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:58 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d56a77e7-39c8-4575-9dbc-aabc16f70350 tempest-VolumesTransfersTest-1795466568 None] Lock "cinder-968ab21c-0d52-4f08-9e94-738c2860402c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:58 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d56a77e7-39c8-4575-9dbc-aabc16f70350 tempest-VolumesTransfersTest-1795466568 None] Acquiring lock "cinder-quobyte-968ab21c-0d52-4f08-9e94-738c2860402c" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:08:58 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d56a77e7-39c8-4575-9dbc-aabc16f70350 tempest-VolumesTransfersTest-1795466568 None] Lock "cinder-quobyte-968ab21c-0d52-4f08-9e94-738c2860402c" acquired by "delete_volume" :: waited 0.008s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:08:58 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f829845a-6fa9-4980-a072-41cda91cb3ea]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:08:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d56a77e7-39c8-4575-9dbc-aabc16f70350 tempest-VolumesTransfersTest-1795466568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-968ab21c-0d52-4f08-9e94-738c2860402c {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:58 devstack sudo[89335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-968ab21c-0d52-4f08-9e94-738c2860402c Feb 27 02:08:58 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:59 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6" returned: 0 in 0.520s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:08:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:08:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1421183-de8a-4ebb-829c-83a99395940e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4bd0715-6f65-4d45-b0db-87a93a037702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:08:59 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Volume volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 (08f0e9fb-ddb9-4499-bea5-5aa06d3440a6): created successfully Feb 27 02:08:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4bd0715-6f65-4d45-b0db-87a93a037702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:08:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Flow 'volume_create_manager' (e1328cf8-3e9b-44c9-9c7b-6aedbc941551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:08:59 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-040ad7ee-9266-48a1-be63-f9c72f882c95 tempest-VolumesSnapshotTestJSON-841936793 None] Created volume successfully. Feb 27 02:08:59 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d56a77e7-39c8-4575-9dbc-aabc16f70350 tempest-VolumesTransfersTest-1795466568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-968ab21c-0d52-4f08-9e94-738c2860402c" returned: 0 in 0.615s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d56a77e7-39c8-4575-9dbc-aabc16f70350 tempest-VolumesTransfersTest-1795466568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-968ab21c-0d52-4f08-9e94-738c2860402c {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:08:59 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-968ab21c-0d52-4f08-9e94-738c2860402c Feb 27 02:08:59 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:08:59 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Feb 27 02:08:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d56a77e7-39c8-4575-9dbc-aabc16f70350 tempest-VolumesTransfersTest-1795466568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-968ab21c-0d52-4f08-9e94-738c2860402c" returned: 0 in 0.475s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:08:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d56a77e7-39c8-4575-9dbc-aabc16f70350 tempest-VolumesTransfersTest-1795466568 None] Lock "cinder-quobyte-968ab21c-0d52-4f08-9e94-738c2860402c" released by "delete_volume" :: held 1.121s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:00 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-d56a77e7-39c8-4575-9dbc-aabc16f70350 tempest-VolumesTransfersTest-1795466568 None] Created reservations ['9adb2965-c81d-4b8d-8d2a-80818d2da0f4', 'dcd6b013-9ccb-4414-b7fe-1dfb2614f4fc', 'ba417a81-a810-4e87-8883-4da3d8f0c843', '8c0df39c-6d5b-4fff-a3bd-3b5df9975bc2'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d56a77e7-39c8-4575-9dbc-aabc16f70350 tempest-VolumesTransfersTest-1795466568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d56a77e7-39c8-4575-9dbc-aabc16f70350 tempest-VolumesTransfersTest-1795466568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d56a77e7-39c8-4575-9dbc-aabc16f70350 tempest-VolumesTransfersTest-1795466568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d56a77e7-39c8-4575-9dbc-aabc16f70350 tempest-VolumesTransfersTest-1795466568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d56a77e7-39c8-4575-9dbc-aabc16f70350 tempest-VolumesTransfersTest-1795466568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d56a77e7-39c8-4575-9dbc-aabc16f70350 tempest-VolumesTransfersTest-1795466568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:00 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:09:00 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c1a2a1a8-c92b-45c7-9d61-a06937a23e83 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c1a2a1a8-c92b-45c7-9d61-a06937a23e83 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-c1a2a1a8-c92b-45c7-9d61-a06937a23e83 tempest-VolumesSnapshotTestJSON-841936793 None] Creating offline snapshot 10260bca-93ad-448f-92cb-a2a1f1ea1ed9 of volume 08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:09:00 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bf4f9d-5410-4c53-8b97-59868d1bf4a6]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c1a2a1a8-c92b-45c7-9d61-a06937a23e83 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:00 devstack sudo[89346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 Feb 27 02:09:00 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:00 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d56a77e7-39c8-4575-9dbc-aabc16f70350 tempest-VolumesTransfersTest-1795466568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.529s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:00 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-d56a77e7-39c8-4575-9dbc-aabc16f70350 tempest-VolumesTransfersTest-1795466568 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:00 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-d56a77e7-39c8-4575-9dbc-aabc16f70350 tempest-VolumesTransfersTest-1795466568 None] Deleted volume successfully. Feb 27 02:09:00 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d56a77e7-39c8-4575-9dbc-aabc16f70350 tempest-VolumesTransfersTest-1795466568 None] Lock "cinder-968ab21c-0d52-4f08-9e94-738c2860402c-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:00 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c1a2a1a8-c92b-45c7-9d61-a06937a23e83 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6" returned: 0 in 0.534s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c1a2a1a8-c92b-45c7-9d61-a06937a23e83 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:00 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9 1G Feb 27 02:09:00 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:01 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c1a2a1a8-c92b-45c7-9d61-a06937a23e83 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9 1G" returned: 0 in 0.595s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c1a2a1a8-c92b-45c7-9d61-a06937a23e83 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:01 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:01 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9 Feb 27 02:09:01 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Flow 'volume_create_manager' (f3ffbcd6-0ba3-46d3-bdab-a6ad3eb6bf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744827f5-afef-4c9d-888d-87048e69655d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744827f5-afef-4c9d-888d-87048e69655d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1611198354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc7ce51-7c4b-46e0-9a58-86022b4a74ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9623a6894b4bcdb987d0d9acb02a73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:01Z,use_quota=True,user_id='7cc9cf7fa9554460b0a4ec994ae6399c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084eec32-5c00-4977-8072-5bbce5529c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084eec32-5c00-4977-8072-5bbce5529c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abf5a90-4b9d-4d77-958f-aeaeb06dac20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abf5a90-4b9d-4d77-958f-aeaeb06dac20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfc7ce51-7c4b-46e0-9a58-86022b4a74ce', 'volume_name': 'volume-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e1455a-2afa-4a00-bf82-074904bdf4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e1455a-2afa-4a00-bf82-074904bdf4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090f62f5-4f46-4141-97be-6402291108ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:01 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Volume cfc7ce51-7c4b-46e0-9a58-86022b4a74ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce', 'volume_size': 1} Feb 27 02:09:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:01 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c1a2a1a8-c92b-45c7-9d61-a06937a23e83 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9" returned: 0 in 0.483s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:01 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-c1a2a1a8-c92b-45c7-9d61-a06937a23e83 tempest-VolumesSnapshotTestJSON-841936793 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9 is being set with open permissions: ugo+rw Feb 27 02:09:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c1a2a1a8-c92b-45c7-9d61-a06937a23e83 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:01 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9 Feb 27 02:09:01 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:02 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c1a2a1a8-c92b-45c7-9d61-a06937a23e83 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9" returned: 0 in 0.458s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c1a2a1a8-c92b-45c7-9d61-a06937a23e83 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:02 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.info Feb 27 02:09:02 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:02 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c1a2a1a8-c92b-45c7-9d61-a06937a23e83 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.info" returned: 0 in 0.445s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:02 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-c1a2a1a8-c92b-45c7-9d61-a06937a23e83 tempest-VolumesSnapshotTestJSON-841936793 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.info is being set with open permissions: ugo+rw Feb 27 02:09:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c1a2a1a8-c92b-45c7-9d61-a06937a23e83 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:02 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.info Feb 27 02:09:02 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:03 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c1a2a1a8-c92b-45c7-9d61-a06937a23e83 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.info" returned: 0 in 0.437s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c1a2a1a8-c92b-45c7-9d61-a06937a23e83 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.014s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.783s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1611198354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc7ce51-7c4b-46e0-9a58-86022b4a74ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac9623a6894b4bcdb987d0d9acb02a73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:01Z,use_quota=True,user_id='7cc9cf7fa9554460b0a4ec994ae6399c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Creating volume cfc7ce51-7c4b-46e0-9a58-86022b4a74ce {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:03 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:09:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:03 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce 1073741824 Feb 27 02:09:03 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:03 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-c1a2a1a8-c92b-45c7-9d61-a06937a23e83 tempest-VolumesSnapshotTestJSON-841936793 None] Create snapshot completed successfully Feb 27 02:09:03 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce 1073741824" returned: 0 in 0.555s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:03 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce Feb 27 02:09:03 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:04 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce" returned: 0 in 0.515s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090f62f5-4f46-4141-97be-6402291108ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7fa8aa-fbfe-4296-9e1c-84b14371946d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:04 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Volume volume-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce (cfc7ce51-7c4b-46e0-9a58-86022b4a74ce): created successfully Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7fa8aa-fbfe-4296-9e1c-84b14371946d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Flow 'volume_create_manager' (f3ffbcd6-0ba3-46d3-bdab-a6ad3eb6bf70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:04 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-082929fd-143e-48b2-b4e8-caa740db2d80 tempest-VolumesTransfersTest-2132905573 None] Created volume successfully. Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Flow 'volume_create_manager' (7168d750-c1f1-4e14-8ad9-35af710c4e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678f0ff7-c55a-43bb-973c-81c99f15250d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678f0ff7-c55a-43bb-973c-81c99f15250d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1188811994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13032d47-6e54-439c-bb7e-ff28030ae867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1267c553a083443bbbb37700541a97a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=10260bca-93ad-448f-92cb-a2a1f1ea1ed9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:05Z,use_quota=True,user_id='c759199de00a445a941b425d62cf8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6304cbf3-6fba-44f3-8cb1-5cac0c0d6625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6304cbf3-6fba-44f3-8cb1-5cac0c0d6625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b24a0f77-4e51-458c-aafb-8678e8fcbc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b24a0f77-4e51-458c-aafb-8678e8fcbc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '13032d47-6e54-439c-bb7e-ff28030ae867', 'volume_name': 'volume-13032d47-6e54-439c-bb7e-ff28030ae867', 'volume_size': 1, 'snapshot_id': '10260bca-93ad-448f-92cb-a2a1f1ea1ed9'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad902fc3-b859-426a-9d4f-8cf5f789aa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad902fc3-b859-426a-9d4f-8cf5f789aa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee4aa89-ab3b-46d6-8114-be59aa102a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:04 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Volume 13032d47-6e54-439c-bb7e-ff28030ae867: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-13032d47-6e54-439c-bb7e-ff28030ae867', 'volume_size': 1, 'snapshot_id': '10260bca-93ad-448f-92cb-a2a1f1ea1ed9'} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-71a347d9-e6bb-41a1-a207-1180bb0792fe tempest-VolumesTransfersTest-1795466568 None] Acquiring lock "cinder-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-quobyte-10260bca-93ad-448f-92cb-a2a1f1ea1ed9-13032d47-6e54-439c-bb7e-ff28030ae867" by "_create_volume_from_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-71a347d9-e6bb-41a1-a207-1180bb0792fe tempest-VolumesTransfersTest-1795466568 None] Lock "cinder-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-10260bca-93ad-448f-92cb-a2a1f1ea1ed9-13032d47-6e54-439c-bb7e-ff28030ae867" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Creating volume 13032d47-6e54-439c-bb7e-ff28030ae867 from snapshot 10260bca-93ad-448f-92cb-a2a1f1ea1ed9 {{(pid=82683) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-quobyte-13032d47-6e54-439c-bb7e-ff28030ae867" by "_copy_volume_from_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-13032d47-6e54-439c-bb7e-ff28030ae867" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] snapshot: 10260bca-93ad-448f-92cb-a2a1f1ea1ed9, volume: 13032d47-6e54-439c-bb7e-ff28030ae867, {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-71a347d9-e6bb-41a1-a207-1180bb0792fe tempest-VolumesTransfersTest-1795466568 None] Acquiring lock "cinder-quobyte-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b578f40d-ea73-4c3a-ab35-173ce94cd386]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-71a347d9-e6bb-41a1-a207-1180bb0792fe tempest-VolumesTransfersTest-1795466568 None] Lock "cinder-quobyte-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce" acquired by "delete_volume" :: waited 0.020s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ea7738-a2d7-4c53-8f8e-aa00ad3c34ed]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-71a347d9-e6bb-41a1-a207-1180bb0792fe tempest-VolumesTransfersTest-1795466568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:05 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9 Feb 27 02:09:05 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:05 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce Feb 27 02:09:05 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:05 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9" returned: 0 in 0.552s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:05 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:05 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:05 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] will copy from snapshot at /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:09:05 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Creating direct copy from snapshot {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:09:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-71a347d9-e6bb-41a1-a207-1180bb0792fe tempest-VolumesTransfersTest-1795466568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce" returned: 0 in 0.529s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-71a347d9-e6bb-41a1-a207-1180bb0792fe tempest-VolumesTransfersTest-1795466568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:05 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c86844f-8137-4245-b867-9ec9b9217d83]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:05 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce Feb 27 02:09:05 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:05 devstack sudo[89390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 Feb 27 02:09:05 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:05 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-71a347d9-e6bb-41a1-a207-1180bb0792fe tempest-VolumesTransfersTest-1795466568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce" returned: 0 in 0.439s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-71a347d9-e6bb-41a1-a207-1180bb0792fe tempest-VolumesTransfersTest-1795466568 None] Lock "cinder-quobyte-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce" released by "delete_volume" :: held 0.990s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:05 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-71a347d9-e6bb-41a1-a207-1180bb0792fe tempest-VolumesTransfersTest-1795466568 None] Created reservations ['43b321e6-6a82-4205-aab2-c472013e1211', 'cacfc1dd-363a-4eb8-9a69-b55223b835f2', '77673362-8ef2-4a11-8971-881663c79dad', '846966ad-efc6-4ea2-98c1-edfabc7cf644'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-71a347d9-e6bb-41a1-a207-1180bb0792fe tempest-VolumesTransfersTest-1795466568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-71a347d9-e6bb-41a1-a207-1180bb0792fe tempest-VolumesTransfersTest-1795466568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:06 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-71a347d9-e6bb-41a1-a207-1180bb0792fe tempest-VolumesTransfersTest-1795466568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:06 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-71a347d9-e6bb-41a1-a207-1180bb0792fe tempest-VolumesTransfersTest-1795466568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-71a347d9-e6bb-41a1-a207-1180bb0792fe tempest-VolumesTransfersTest-1795466568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-71a347d9-e6bb-41a1-a207-1180bb0792fe tempest-VolumesTransfersTest-1795466568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:06 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6" returned: 0 in 0.539s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:06 devstack cinder-volume[82683]: DEBUG cinder.utils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Path /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-13032d47-6e54-439c-bb7e-ff28030ae867 not found in is_blk_device check {{(pid=82683) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:09:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-13032d47-6e54-439c-bb7e-ff28030ae867 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:06 devstack sudo[89397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:09:06 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:06 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-13032d47-6e54-439c-bb7e-ff28030ae867 Feb 27 02:09:06 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:06 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-71a347d9-e6bb-41a1-a207-1180bb0792fe tempest-VolumesTransfersTest-1795466568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.465s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:06 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-71a347d9-e6bb-41a1-a207-1180bb0792fe tempest-VolumesTransfersTest-1795466568 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:06 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-71a347d9-e6bb-41a1-a207-1180bb0792fe tempest-VolumesTransfersTest-1795466568 None] Deleted volume successfully. Feb 27 02:09:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-71a347d9-e6bb-41a1-a207-1180bb0792fe tempest-VolumesTransfersTest-1795466568 None] Lock "cinder-cfc7ce51-7c4b-46e0-9a58-86022b4a74ce-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:08 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-13032d47-6e54-439c-bb7e-ff28030ae867" returned: 0 in 2.422s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:08 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[824bb9be-2832-4a1d-ab50-133e5fe8274d]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:08 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 Feb 27 02:09:08 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:09 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6" returned: 0 in 0.721s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:09 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Image conversion details: src /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6, size 1024.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-13032d47-6e54-439c-bb7e-ff28030ae867 {{(pid=82683) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:09:09 devstack cinder-volume[82683]: INFO cinder.image.image_utils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Converted 1024.00 MB image at 422.66 MB/s Feb 27 02:09:09 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-13032d47-6e54-439c-bb7e-ff28030ae867 is being set with open permissions: ugo+rw Feb 27 02:09:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-13032d47-6e54-439c-bb7e-ff28030ae867 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:09 devstack sudo[89459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-13032d47-6e54-439c-bb7e-ff28030ae867 Feb 27 02:09:09 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:09 devstack cinder-volume[82683]: DEBUG oslo_service.periodic_task [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:09:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:09 devstack sudo[89461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:09:09 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:09 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-13032d47-6e54-439c-bb7e-ff28030ae867" returned: 0 in 0.509s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:09 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-13032d47-6e54-439c-bb7e-ff28030ae867" released by "_copy_volume_from_snapshot" :: held 4.824s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:09 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-10260bca-93ad-448f-92cb-a2a1f1ea1ed9-13032d47-6e54-439c-bb7e-ff28030ae867" released by "_create_volume_from_snapshot" :: held 4.850s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.869s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:09 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee4aa89-ab3b-46d6-8114-be59aa102a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13032d47-6e54-439c-bb7e-ff28030ae867', 'volume_size': 1, 'snapshot_id': '10260bca-93ad-448f-92cb-a2a1f1ea1ed9'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:09 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c655a56c-a0aa-4e09-95c4-a923f969c477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:09 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Volume volume-13032d47-6e54-439c-bb7e-ff28030ae867 (13032d47-6e54-439c-bb7e-ff28030ae867): created successfully Feb 27 02:09:09 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c655a56c-a0aa-4e09-95c4-a923f969c477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:09 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Flow 'volume_create_manager' (7168d750-c1f1-4e14-8ad9-35af710c4e7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:09 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-4fe9c7e6-d060-4841-bef4-6f97b7c2cb41 tempest-VolumesSnapshotTestJSON-841936793 None] Created volume successfully. Feb 27 02:09:09 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.564s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:09 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:10 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d7c5b7d9-c2a5-4e70-8c48-d7185f6f6298 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-13032d47-6e54-439c-bb7e-ff28030ae867-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:10 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d7c5b7d9-c2a5-4e70-8c48-d7185f6f6298 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-13032d47-6e54-439c-bb7e-ff28030ae867-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:10 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d7c5b7d9-c2a5-4e70-8c48-d7185f6f6298 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-quobyte-13032d47-6e54-439c-bb7e-ff28030ae867" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:10 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d7c5b7d9-c2a5-4e70-8c48-d7185f6f6298 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-13032d47-6e54-439c-bb7e-ff28030ae867" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:10 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[837b7d62-e005-4bc0-9c60-775a75cdd883]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d7c5b7d9-c2a5-4e70-8c48-d7185f6f6298 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-13032d47-6e54-439c-bb7e-ff28030ae867 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:10 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-13032d47-6e54-439c-bb7e-ff28030ae867 Feb 27 02:09:10 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:10 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d7c5b7d9-c2a5-4e70-8c48-d7185f6f6298 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-13032d47-6e54-439c-bb7e-ff28030ae867" returned: 0 in 0.582s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d7c5b7d9-c2a5-4e70-8c48-d7185f6f6298 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-13032d47-6e54-439c-bb7e-ff28030ae867 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:10 devstack sudo[89470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-13032d47-6e54-439c-bb7e-ff28030ae867 Feb 27 02:09:10 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:11 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d7c5b7d9-c2a5-4e70-8c48-d7185f6f6298 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-13032d47-6e54-439c-bb7e-ff28030ae867" returned: 0 in 0.509s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d7c5b7d9-c2a5-4e70-8c48-d7185f6f6298 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-13032d47-6e54-439c-bb7e-ff28030ae867" released by "delete_volume" :: held 1.116s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-d7c5b7d9-c2a5-4e70-8c48-d7185f6f6298 tempest-VolumesSnapshotTestJSON-841936793 None] Created reservations ['65dcda1b-04f9-4578-9c4e-8f81304f32fb', 'c12b46d5-d78e-49f4-9477-86cb15ae376d', '8a5671f2-944c-481a-b552-0959ed0a85d7', '7ac0f548-123a-461e-9774-b7ee104341e0'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d7c5b7d9-c2a5-4e70-8c48-d7185f6f6298 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d7c5b7d9-c2a5-4e70-8c48-d7185f6f6298 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d7c5b7d9-c2a5-4e70-8c48-d7185f6f6298 tempest-VolumesSnapshotTestJSON-841936793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d7c5b7d9-c2a5-4e70-8c48-d7185f6f6298 tempest-VolumesSnapshotTestJSON-841936793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d7c5b7d9-c2a5-4e70-8c48-d7185f6f6298 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d7c5b7d9-c2a5-4e70-8c48-d7185f6f6298 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:11 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:09:11 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Flow 'volume_create_manager' (72ef1b0e-74c4-4b1c-bf1b-d75ce137d393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4067eb-577e-4052-b080-c3fd9e1534ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4067eb-577e-4052-b080-c3fd9e1534ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1838426813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec8eb08-e8fd-41c6-a79b-304ce7e8786f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0025adc83147508fd4e481ee0e8a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:12Z,use_quota=True,user_id='74938b7d1b2b4eb698679f1d40c1153e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47db26b-de4f-4c44-989a-c5a5c2bc5aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47db26b-de4f-4c44-989a-c5a5c2bc5aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb1bbc9-8189-4828-a8fa-ae701c2cc5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb1bbc9-8189-4828-a8fa-ae701c2cc5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec8eb08-e8fd-41c6-a79b-304ce7e8786f', 'volume_name': 'volume-bec8eb08-e8fd-41c6-a79b-304ce7e8786f', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a92fec-ce37-4d79-aa67-bd9406346fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a92fec-ce37-4d79-aa67-bd9406346fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4180682-8e03-4a92-a2ff-c0a801bed13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:11 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Volume bec8eb08-e8fd-41c6-a79b-304ce7e8786f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec8eb08-e8fd-41c6-a79b-304ce7e8786f', 'volume_size': 1} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1838426813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec8eb08-e8fd-41c6-a79b-304ce7e8786f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0025adc83147508fd4e481ee0e8a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:12Z,use_quota=True,user_id='74938b7d1b2b4eb698679f1d40c1153e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Creating volume bec8eb08-e8fd-41c6-a79b-304ce7e8786f {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:11 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bec8eb08-e8fd-41c6-a79b-304ce7e8786f 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:11 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bec8eb08-e8fd-41c6-a79b-304ce7e8786f 1073741824 Feb 27 02:09:11 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:11 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d7c5b7d9-c2a5-4e70-8c48-d7185f6f6298 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.441s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:11 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-d7c5b7d9-c2a5-4e70-8c48-d7185f6f6298 tempest-VolumesSnapshotTestJSON-841936793 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:11 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-d7c5b7d9-c2a5-4e70-8c48-d7185f6f6298 tempest-VolumesSnapshotTestJSON-841936793 None] Deleted volume successfully. Feb 27 02:09:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d7c5b7d9-c2a5-4e70-8c48-d7185f6f6298 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-13032d47-6e54-439c-bb7e-ff28030ae867-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:12 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bec8eb08-e8fd-41c6-a79b-304ce7e8786f 1073741824" returned: 0 in 0.509s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:12 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:SELECT=116,cinder:INSERT=37,cinder:UPDATE=126,cinder:DELETE=14 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:09:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bec8eb08-e8fd-41c6-a79b-304ce7e8786f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:12 devstack sudo[89481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bec8eb08-e8fd-41c6-a79b-304ce7e8786f Feb 27 02:09:12 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-10260bca-93ad-448f-92cb-a2a1f1ea1ed9-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-10260bca-93ad-448f-92cb-a2a1f1ea1ed9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-quobyte-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-quobyte-10260bca-93ad-448f-92cb-a2a1f1ea1ed9" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:12 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-10260bca-93ad-448f-92cb-a2a1f1ea1ed9" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:12 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] Deleting offline snapshot 10260bca-93ad-448f-92cb-a2a1f1ea1ed9 of volume 08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:09:12 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] snapshot_file for this snap is: volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:09:12 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5a6d81-3fdc-4983-8138-2b77851527f4]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:12 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9 Feb 27 02:09:12 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:12 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bec8eb08-e8fd-41c6-a79b-304ce7e8786f" returned: 0 in 0.445s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:12 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4180682-8e03-4a92-a2ff-c0a801bed13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec8eb08-e8fd-41c6-a79b-304ce7e8786f', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1b85f5-f3f6-4a48-b4cd-ce57c69b16c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:12 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Volume volume-bec8eb08-e8fd-41c6-a79b-304ce7e8786f (bec8eb08-e8fd-41c6-a79b-304ce7e8786f): created successfully Feb 27 02:09:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1b85f5-f3f6-4a48-b4cd-ce57c69b16c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Flow 'volume_create_manager' (72ef1b0e-74c4-4b1c-bf1b-d75ce137d393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:12 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-8e1a97e1-7831-4ff2-b2a6-2231cd852238 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Created volume successfully. Feb 27 02:09:13 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9" returned: 0 in 0.504s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:13 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2621dcb-f890-495d-a625-8b0de7f3e62f]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:13 devstack sudo[89489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 Feb 27 02:09:13 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:13 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6" returned: 0 in 0.499s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:13 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9 Feb 27 02:09:13 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:14 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9" returned: 0 in 0.596s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:14 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9 Feb 27 02:09:14 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Flow 'volume_create_manager' (9df965a3-c3a4-44cc-85f1-91c9a626ede7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c30df3-b8e8-4031-a9f4-7bd421eeded0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c30df3-b8e8-4031-a9f4-7bd421eeded0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-382052036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9999153c-5588-439a-9e12-1ca882d51c54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0025adc83147508fd4e481ee0e8a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:14Z,use_quota=True,user_id='74938b7d1b2b4eb698679f1d40c1153e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3620162-acbe-485d-9607-84a17213f995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3620162-acbe-485d-9607-84a17213f995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5915ea1f-00be-4321-95d2-cd92abfefc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5915ea1f-00be-4321-95d2-cd92abfefc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9999153c-5588-439a-9e12-1ca882d51c54', 'volume_name': 'volume-9999153c-5588-439a-9e12-1ca882d51c54', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021a56b6-ba70-4a95-ba1c-4a5735fa33ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (021a56b6-ba70-4a95-ba1c-4a5735fa33ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f98c4e-a8a2-42fe-b567-188c35409c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Volume 9999153c-5588-439a-9e12-1ca882d51c54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9999153c-5588-439a-9e12-1ca882d51c54', 'volume_size': 1} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-382052036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9999153c-5588-439a-9e12-1ca882d51c54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0025adc83147508fd4e481ee0e8a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:14Z,use_quota=True,user_id='74938b7d1b2b4eb698679f1d40c1153e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Creating volume 9999153c-5588-439a-9e12-1ca882d51c54 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:14 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9999153c-5588-439a-9e12-1ca882d51c54 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:14 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9999153c-5588-439a-9e12-1ca882d51c54 1073741824 Feb 27 02:09:14 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Flow 'volume_create_manager' (1ec7d54f-f57a-4d11-8d5e-d3b9bfcc9b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88776e79-b310-4253-8ac0-104b56e5f9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88776e79-b310-4253-8ac0-104b56e5f9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1593292602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee0ac2c-f03e-4f52-8923-de0bc14c570a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0025adc83147508fd4e481ee0e8a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:14Z,use_quota=True,user_id='74938b7d1b2b4eb698679f1d40c1153e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3998dd5-57a2-4e15-8c8a-ad14d47896ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3998dd5-57a2-4e15-8c8a-ad14d47896ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73741b2-d8eb-409d-aa1b-ae3e86f7f696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73741b2-d8eb-409d-aa1b-ae3e86f7f696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ee0ac2c-f03e-4f52-8923-de0bc14c570a', 'volume_name': 'volume-0ee0ac2c-f03e-4f52-8923-de0bc14c570a', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5af9e96-ef44-463c-8224-3db14ef0db98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5af9e96-ef44-463c-8224-3db14ef0db98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff46db9-f0c9-449b-a8ff-04cbd334cbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Volume 0ee0ac2c-f03e-4f52-8923-de0bc14c570a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ee0ac2c-f03e-4f52-8923-de0bc14c570a', 'volume_size': 1} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Flow 'volume_create_manager' (c3d82ca3-0b43-4f92-9376-956c47b49e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84592fd0-2d95-44e5-b4fe-4b0a9836910f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84592fd0-2d95-44e5-b4fe-4b0a9836910f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-421718807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78163cab-b2bd-4835-8b09-59e5370987dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0025adc83147508fd4e481ee0e8a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:15Z,use_quota=True,user_id='74938b7d1b2b4eb698679f1d40c1153e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4285540c-f1df-42f7-909d-25e0b5ab86b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4285540c-f1df-42f7-909d-25e0b5ab86b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f48115c-07af-4e8e-b611-9846e0afbfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f48115c-07af-4e8e-b611-9846e0afbfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78163cab-b2bd-4835-8b09-59e5370987dc', 'volume_name': 'volume-78163cab-b2bd-4835-8b09-59e5370987dc', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffcb8516-e484-45fe-ac86-e3cd4f9f623e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffcb8516-e484-45fe-ac86-e3cd4f9f623e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c33654-9e44-46bf-a89a-655177f0ea6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Volume 78163cab-b2bd-4835-8b09-59e5370987dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78163cab-b2bd-4835-8b09-59e5370987dc', 'volume_size': 1} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:14 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6.10260bca-93ad-448f-92cb-a2a1f1ea1ed9" returned: 0 in 0.555s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-10260bca-93ad-448f-92cb-a2a1f1ea1ed9" released by "_delete_snapshot" :: held 2.231s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6" released by "delete_snapshot" :: held 2.247s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] Created reservations ['b2755d41-7264-4038-8338-4cb1fd029d31', '6477a6d3-19bb-4363-8f23-6dcbd6ac1235', 'b181bbee-371a-4b43-a199-71fe677db412', 'dd9794e8-eac2-4868-a274-2f10d24d141d'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Flow 'volume_create_manager' (297851ff-5cc4-422a-8af7-e50f2320416a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68db2f8e-a049-4c1f-868a-555dc261f575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68db2f8e-a049-4c1f-868a-555dc261f575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1641463295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e34ddae7-af0f-4539-a2d0-cfae5670a501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0025adc83147508fd4e481ee0e8a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:15Z,use_quota=True,user_id='74938b7d1b2b4eb698679f1d40c1153e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ac9ac9-52fa-4897-8c18-041275b4844d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ac9ac9-52fa-4897-8c18-041275b4844d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de0e02e-9138-4d56-b664-055c98641c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de0e02e-9138-4d56-b664-055c98641c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e34ddae7-af0f-4539-a2d0-cfae5670a501', 'volume_name': 'volume-e34ddae7-af0f-4539-a2d0-cfae5670a501', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcff7037-b043-4ea1-bf3a-98dfc37ed7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcff7037-b043-4ea1-bf3a-98dfc37ed7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901863e1-b5ce-4a6a-8c20-18ba6c699dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:14 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Volume e34ddae7-af0f-4539-a2d0-cfae5670a501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e34ddae7-af0f-4539-a2d0-cfae5670a501', 'volume_size': 1} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9999153c-5588-439a-9e12-1ca882d51c54 1073741824" returned: 0 in 0.638s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9999153c-5588-439a-9e12-1ca882d51c54 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:14 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] Delete snapshot completed successfully. Feb 27 02:09:14 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-14da23a1-d770-40e9-a29c-cbd04c6cfc29 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-10260bca-93ad-448f-92cb-a2a1f1ea1ed9-delete_snapshot" released by "delete_snapshot" :: held 2.462s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:14 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9999153c-5588-439a-9e12-1ca882d51c54 Feb 27 02:09:14 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Flow 'volume_create_manager' (69af0b1c-8f8c-4d3e-89ba-d45cc974f7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fb7fdb-4fb1-480b-b56b-c356d8319f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fb7fdb-4fb1-480b-b56b-c356d8319f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-245489426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f40d880-2d26-44ee-9656-20ec1d39d318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0025adc83147508fd4e481ee0e8a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:15Z,use_quota=True,user_id='74938b7d1b2b4eb698679f1d40c1153e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf07c1a-9acb-48e6-93fa-f901adf34882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf07c1a-9acb-48e6-93fa-f901adf34882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b4783c3-dede-4605-8974-78d650f448ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b4783c3-dede-4605-8974-78d650f448ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f40d880-2d26-44ee-9656-20ec1d39d318', 'volume_name': 'volume-8f40d880-2d26-44ee-9656-20ec1d39d318', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae52189-7da5-43e5-af74-6d0fa5ff608b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae52189-7da5-43e5-af74-6d0fa5ff608b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed17006c-0688-442b-849d-1b06e9014eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:15 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Volume 8f40d880-2d26-44ee-9656-20ec1d39d318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f40d880-2d26-44ee-9656-20ec1d39d318', 'volume_size': 1} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:15 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9999153c-5588-439a-9e12-1ca882d51c54" returned: 0 in 0.483s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.936s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1593292602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ee0ac2c-f03e-4f52-8923-de0bc14c570a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0025adc83147508fd4e481ee0e8a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:14Z,use_quota=True,user_id='74938b7d1b2b4eb698679f1d40c1153e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Creating volume 0ee0ac2c-f03e-4f52-8923-de0bc14c570a {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:15 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0ee0ac2c-f03e-4f52-8923-de0bc14c570a 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f98c4e-a8a2-42fe-b567-188c35409c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9999153c-5588-439a-9e12-1ca882d51c54', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc91106-d213-4cef-b1d6-952dcf801a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:15 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0ee0ac2c-f03e-4f52-8923-de0bc14c570a 1073741824 Feb 27 02:09:15 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:15 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Volume volume-9999153c-5588-439a-9e12-1ca882d51c54 (9999153c-5588-439a-9e12-1ca882d51c54): created successfully Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc91106-d213-4cef-b1d6-952dcf801a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Flow 'volume_create_manager' (9df965a3-c3a4-44cc-85f1-91c9a626ede7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:15 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-4712c724-fc6e-4cea-a766-4bd20297358d tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Created volume successfully. Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1290a62f-a69b-46a4-a57e-6a964d3568c0 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1290a62f-a69b-46a4-a57e-6a964d3568c0 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:SELECT=119,cinder:UPDATE=149,cinder:INSERT=42,cinder:DELETE=12 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1290a62f-a69b-46a4-a57e-6a964d3568c0 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-quobyte-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1290a62f-a69b-46a4-a57e-6a964d3568c0 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6" acquired by "delete_volume" :: waited 0.015s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cccd14-5493-4585-881f-ba6cd4626cef]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1290a62f-a69b-46a4-a57e-6a964d3568c0 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:15 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 Feb 27 02:09:15 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:16 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0ee0ac2c-f03e-4f52-8923-de0bc14c570a 1073741824" returned: 0 in 0.597s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0ee0ac2c-f03e-4f52-8923-de0bc14c570a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:16 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0ee0ac2c-f03e-4f52-8923-de0bc14c570a Feb 27 02:09:16 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:16 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1290a62f-a69b-46a4-a57e-6a964d3568c0 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6" returned: 0 in 0.644s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1290a62f-a69b-46a4-a57e-6a964d3568c0 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:16 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6 Feb 27 02:09:16 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:16 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0ee0ac2c-f03e-4f52-8923-de0bc14c570a" returned: 0 in 0.489s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.891s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-421718807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78163cab-b2bd-4835-8b09-59e5370987dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0025adc83147508fd4e481ee0e8a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:15Z,use_quota=True,user_id='74938b7d1b2b4eb698679f1d40c1153e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Creating volume 78163cab-b2bd-4835-8b09-59e5370987dc {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:16 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:09:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78163cab-b2bd-4835-8b09-59e5370987dc 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:16 devstack sudo[89525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78163cab-b2bd-4835-8b09-59e5370987dc 1073741824 Feb 27 02:09:16 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff46db9-f0c9-449b-a8ff-04cbd334cbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ee0ac2c-f03e-4f52-8923-de0bc14c570a', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8f3a13-ee28-4b9a-9782-95867a186b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:16 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Volume volume-0ee0ac2c-f03e-4f52-8923-de0bc14c570a (0ee0ac2c-f03e-4f52-8923-de0bc14c570a): created successfully Feb 27 02:09:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8f3a13-ee28-4b9a-9782-95867a186b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Flow 'volume_create_manager' (1ec7d54f-f57a-4d11-8d5e-d3b9bfcc9b7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:16 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-6176bb6b-abc2-4a93-80b7-624752a83f08 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Created volume successfully. Feb 27 02:09:17 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1290a62f-a69b-46a4-a57e-6a964d3568c0 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6" returned: 0 in 0.579s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:17 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1290a62f-a69b-46a4-a57e-6a964d3568c0 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6" released by "delete_volume" :: held 1.274s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:17 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-1290a62f-a69b-46a4-a57e-6a964d3568c0 tempest-VolumesSnapshotTestJSON-841936793 None] Created reservations ['f0f2a179-6105-47ab-a5ed-5f463ca32a02', 'bc441092-65ea-454e-9154-e30b6aa8f303', 'bed857b5-54e0-4d60-86d8-5f48781fd00b', '2a1f175a-dd7d-493d-8f3a-c5b1a057ac11'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1290a62f-a69b-46a4-a57e-6a964d3568c0 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1290a62f-a69b-46a4-a57e-6a964d3568c0 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:17 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1290a62f-a69b-46a4-a57e-6a964d3568c0 tempest-VolumesSnapshotTestJSON-841936793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:17 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1290a62f-a69b-46a4-a57e-6a964d3568c0 tempest-VolumesSnapshotTestJSON-841936793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1290a62f-a69b-46a4-a57e-6a964d3568c0 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1290a62f-a69b-46a4-a57e-6a964d3568c0 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:17 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:09:17 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:17 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78163cab-b2bd-4835-8b09-59e5370987dc 1073741824" returned: 0 in 0.756s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78163cab-b2bd-4835-8b09-59e5370987dc {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:17 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78163cab-b2bd-4835-8b09-59e5370987dc Feb 27 02:09:17 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:17 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1290a62f-a69b-46a4-a57e-6a964d3568c0 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.639s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:17 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-1290a62f-a69b-46a4-a57e-6a964d3568c0 tempest-VolumesSnapshotTestJSON-841936793 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:17 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-1290a62f-a69b-46a4-a57e-6a964d3568c0 tempest-VolumesSnapshotTestJSON-841936793 None] Deleted volume successfully. Feb 27 02:09:17 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1290a62f-a69b-46a4-a57e-6a964d3568c0 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-08f0e9fb-ddb9-4499-bea5-5aa06d3440a6-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:18 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78163cab-b2bd-4835-8b09-59e5370987dc" returned: 0 in 0.620s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.078s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1641463295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e34ddae7-af0f-4539-a2d0-cfae5670a501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0025adc83147508fd4e481ee0e8a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:15Z,use_quota=True,user_id='74938b7d1b2b4eb698679f1d40c1153e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Creating volume e34ddae7-af0f-4539-a2d0-cfae5670a501 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:18 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e34ddae7-af0f-4539-a2d0-cfae5670a501 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-74da25fc-724d-4b9f-a512-01b83e796b70 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-8a4439f1-b0f2-468e-b996-86b3372d661d-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:18 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e34ddae7-af0f-4539-a2d0-cfae5670a501 1073741824 Feb 27 02:09:18 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c33654-9e44-46bf-a89a-655177f0ea6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78163cab-b2bd-4835-8b09-59e5370987dc', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2da1d6d-7eb8-4200-99bf-39275c4988ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-74da25fc-724d-4b9f-a512-01b83e796b70 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-8a4439f1-b0f2-468e-b996-86b3372d661d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:18 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Volume volume-78163cab-b2bd-4835-8b09-59e5370987dc (78163cab-b2bd-4835-8b09-59e5370987dc): created successfully Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2da1d6d-7eb8-4200-99bf-39275c4988ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Flow 'volume_create_manager' (c3d82ca3-0b43-4f92-9376-956c47b49e2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:18 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-46f66837-6f4c-4df3-b4f4-8bba770148a8 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Created volume successfully. Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-74da25fc-724d-4b9f-a512-01b83e796b70 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "cinder-quobyte-8a4439f1-b0f2-468e-b996-86b3372d661d" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-74da25fc-724d-4b9f-a512-01b83e796b70 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-8a4439f1-b0f2-468e-b996-86b3372d661d" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0036b72-12f9-4038-a63e-efcd2aa7f1e0]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-74da25fc-724d-4b9f-a512-01b83e796b70 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:18 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d Feb 27 02:09:18 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:18 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e34ddae7-af0f-4539-a2d0-cfae5670a501 1073741824" returned: 0 in 0.728s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e34ddae7-af0f-4539-a2d0-cfae5670a501 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:18 devstack sudo[89548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e34ddae7-af0f-4539-a2d0-cfae5670a501 Feb 27 02:09:18 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:18 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-74da25fc-724d-4b9f-a512-01b83e796b70 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d" returned: 0 in 0.713s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-74da25fc-724d-4b9f-a512-01b83e796b70 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:18 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d Feb 27 02:09:18 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:19 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e34ddae7-af0f-4539-a2d0-cfae5670a501" returned: 0 in 0.494s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.136s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-245489426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f40d880-2d26-44ee-9656-20ec1d39d318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0025adc83147508fd4e481ee0e8a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:15Z,use_quota=True,user_id='74938b7d1b2b4eb698679f1d40c1153e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Creating volume 8f40d880-2d26-44ee-9656-20ec1d39d318 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:19 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8f40d880-2d26-44ee-9656-20ec1d39d318 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901863e1-b5ce-4a6a-8c20-18ba6c699dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e34ddae7-af0f-4539-a2d0-cfae5670a501', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02380f8d-5566-4bec-a668-6f50d48a5ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:19 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8f40d880-2d26-44ee-9656-20ec1d39d318 1073741824 Feb 27 02:09:19 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:19 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Volume volume-e34ddae7-af0f-4539-a2d0-cfae5670a501 (e34ddae7-af0f-4539-a2d0-cfae5670a501): created successfully Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02380f8d-5566-4bec-a668-6f50d48a5ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Flow 'volume_create_manager' (297851ff-5cc4-422a-8af7-e50f2320416a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:19 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-d1bbbb61-ad8f-494c-a997-a1ba21054d71 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Created volume successfully. Feb 27 02:09:19 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-74da25fc-724d-4b9f-a512-01b83e796b70 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8a4439f1-b0f2-468e-b996-86b3372d661d" returned: 0 in 0.493s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-74da25fc-724d-4b9f-a512-01b83e796b70 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-quobyte-8a4439f1-b0f2-468e-b996-86b3372d661d" released by "delete_volume" :: held 1.245s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-74da25fc-724d-4b9f-a512-01b83e796b70 tempest-VolumesSnapshotTestJSON-841936793 None] Created reservations ['e92665ea-cbe7-441d-87be-6eaa4a4fddf2', 'cb063c25-68c8-4069-8ca0-224ad78333e4', '50ce00a8-c629-4218-9bca-48d51143151e', 'b47ec1ed-340e-46c3-b469-3df056dfc4ec'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-74da25fc-724d-4b9f-a512-01b83e796b70 tempest-VolumesSnapshotTestJSON-841936793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-74da25fc-724d-4b9f-a512-01b83e796b70 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-74da25fc-724d-4b9f-a512-01b83e796b70 tempest-VolumesSnapshotTestJSON-841936793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-74da25fc-724d-4b9f-a512-01b83e796b70 tempest-VolumesSnapshotTestJSON-841936793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-74da25fc-724d-4b9f-a512-01b83e796b70 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-74da25fc-724d-4b9f-a512-01b83e796b70 tempest-VolumesSnapshotTestJSON-841936793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:19 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:09:19 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:19 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-74da25fc-724d-4b9f-a512-01b83e796b70 tempest-VolumesSnapshotTestJSON-841936793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.481s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:19 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-74da25fc-724d-4b9f-a512-01b83e796b70 tempest-VolumesSnapshotTestJSON-841936793 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:20 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-74da25fc-724d-4b9f-a512-01b83e796b70 tempest-VolumesSnapshotTestJSON-841936793 None] Deleted volume successfully. Feb 27 02:09:20 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:20 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-74da25fc-724d-4b9f-a512-01b83e796b70 tempest-VolumesSnapshotTestJSON-841936793 None] Lock "cinder-8a4439f1-b0f2-468e-b996-86b3372d661d-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8f40d880-2d26-44ee-9656-20ec1d39d318 1073741824" returned: 0 in 0.706s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8f40d880-2d26-44ee-9656-20ec1d39d318 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:20 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8f40d880-2d26-44ee-9656-20ec1d39d318 Feb 27 02:09:20 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:20 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8f40d880-2d26-44ee-9656-20ec1d39d318" returned: 0 in 0.505s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:20 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed17006c-0688-442b-849d-1b06e9014eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f40d880-2d26-44ee-9656-20ec1d39d318', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c09963f-c125-4abe-acdb-73215b0846c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:20 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Volume volume-8f40d880-2d26-44ee-9656-20ec1d39d318 (8f40d880-2d26-44ee-9656-20ec1d39d318): created successfully Feb 27 02:09:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c09963f-c125-4abe-acdb-73215b0846c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Flow 'volume_create_manager' (69af0b1c-8f8c-4d3e-89ba-d45cc974f7f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:20 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-9882ec10-d42c-4474-b989-393238536220 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Created volume successfully. Feb 27 02:09:20 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d4b352d7-8f4d-4ef7-826e-26602fa94d3b tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "cinder-8f40d880-2d26-44ee-9656-20ec1d39d318-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:20 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d4b352d7-8f4d-4ef7-826e-26602fa94d3b tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-8f40d880-2d26-44ee-9656-20ec1d39d318-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:20 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d4b352d7-8f4d-4ef7-826e-26602fa94d3b tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "cinder-quobyte-8f40d880-2d26-44ee-9656-20ec1d39d318" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:20 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d4b352d7-8f4d-4ef7-826e-26602fa94d3b tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-quobyte-8f40d880-2d26-44ee-9656-20ec1d39d318" acquired by "delete_volume" :: waited 0.015s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:20 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aa4938-dceb-4b50-9fd6-3af7c90f4168]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d4b352d7-8f4d-4ef7-826e-26602fa94d3b tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8f40d880-2d26-44ee-9656-20ec1d39d318 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:21 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8f40d880-2d26-44ee-9656-20ec1d39d318 Feb 27 02:09:21 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:21 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d4b352d7-8f4d-4ef7-826e-26602fa94d3b tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8f40d880-2d26-44ee-9656-20ec1d39d318" returned: 0 in 0.611s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d4b352d7-8f4d-4ef7-826e-26602fa94d3b tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8f40d880-2d26-44ee-9656-20ec1d39d318 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:21 devstack sudo[89571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8f40d880-2d26-44ee-9656-20ec1d39d318 Feb 27 02:09:21 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:22 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d4b352d7-8f4d-4ef7-826e-26602fa94d3b tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-8f40d880-2d26-44ee-9656-20ec1d39d318" returned: 0 in 0.519s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d4b352d7-8f4d-4ef7-826e-26602fa94d3b tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-quobyte-8f40d880-2d26-44ee-9656-20ec1d39d318" released by "delete_volume" :: held 1.163s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:22 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-d4b352d7-8f4d-4ef7-826e-26602fa94d3b tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Created reservations ['51b42d13-6cff-41df-8645-3a5849280b18', 'c525be4d-fab5-4cd8-bba2-1d2825616d70', '7926da0c-417a-470d-bf0e-b05e655693c0', '6c5bd296-d644-4d90-bcc8-a074d60422f9'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d4b352d7-8f4d-4ef7-826e-26602fa94d3b tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d4b352d7-8f4d-4ef7-826e-26602fa94d3b tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d4b352d7-8f4d-4ef7-826e-26602fa94d3b tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d4b352d7-8f4d-4ef7-826e-26602fa94d3b tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d4b352d7-8f4d-4ef7-826e-26602fa94d3b tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d4b352d7-8f4d-4ef7-826e-26602fa94d3b tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:22 devstack sudo[89575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:09:22 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:22 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d4b352d7-8f4d-4ef7-826e-26602fa94d3b tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.498s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:22 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-d4b352d7-8f4d-4ef7-826e-26602fa94d3b tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:22 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-d4b352d7-8f4d-4ef7-826e-26602fa94d3b tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Deleted volume successfully. Feb 27 02:09:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d4b352d7-8f4d-4ef7-826e-26602fa94d3b tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-8f40d880-2d26-44ee-9656-20ec1d39d318-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acffb2c1-aa78-44eb-a533-f84976d1dc2e tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "cinder-e34ddae7-af0f-4539-a2d0-cfae5670a501-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:23 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acffb2c1-aa78-44eb-a533-f84976d1dc2e tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-e34ddae7-af0f-4539-a2d0-cfae5670a501-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:23 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acffb2c1-aa78-44eb-a533-f84976d1dc2e tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "cinder-quobyte-e34ddae7-af0f-4539-a2d0-cfae5670a501" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:23 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acffb2c1-aa78-44eb-a533-f84976d1dc2e tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-quobyte-e34ddae7-af0f-4539-a2d0-cfae5670a501" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:23 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa27e108-4deb-4d25-b967-0ba421e8778c]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acffb2c1-aa78-44eb-a533-f84976d1dc2e tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e34ddae7-af0f-4539-a2d0-cfae5670a501 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:23 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e34ddae7-af0f-4539-a2d0-cfae5670a501 Feb 27 02:09:23 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:23 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acffb2c1-aa78-44eb-a533-f84976d1dc2e tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e34ddae7-af0f-4539-a2d0-cfae5670a501" returned: 0 in 0.615s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acffb2c1-aa78-44eb-a533-f84976d1dc2e tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e34ddae7-af0f-4539-a2d0-cfae5670a501 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:23 devstack sudo[89584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e34ddae7-af0f-4539-a2d0-cfae5670a501 Feb 27 02:09:23 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:24 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acffb2c1-aa78-44eb-a533-f84976d1dc2e tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e34ddae7-af0f-4539-a2d0-cfae5670a501" returned: 0 in 0.531s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:24 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acffb2c1-aa78-44eb-a533-f84976d1dc2e tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-quobyte-e34ddae7-af0f-4539-a2d0-cfae5670a501" released by "delete_volume" :: held 1.179s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:24 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-acffb2c1-aa78-44eb-a533-f84976d1dc2e tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Created reservations ['616f5838-0178-4007-9eab-16a5dcde22a0', '70113b54-c54c-463c-a6f2-bc48c6633750', 'a10cba2b-bb92-41c4-bcb1-4c368609ec70', 'f542842b-6849-4bca-8c56-0fa4fbecf234'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-acffb2c1-aa78-44eb-a533-f84976d1dc2e tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-acffb2c1-aa78-44eb-a533-f84976d1dc2e tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:24 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-acffb2c1-aa78-44eb-a533-f84976d1dc2e tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:24 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-acffb2c1-aa78-44eb-a533-f84976d1dc2e tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-acffb2c1-aa78-44eb-a533-f84976d1dc2e tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acffb2c1-aa78-44eb-a533-f84976d1dc2e tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:24 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:09:24 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:24 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-acffb2c1-aa78-44eb-a533-f84976d1dc2e tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.483s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:24 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-acffb2c1-aa78-44eb-a533-f84976d1dc2e tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:24 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-acffb2c1-aa78-44eb-a533-f84976d1dc2e tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Deleted volume successfully. Feb 27 02:09:24 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-acffb2c1-aa78-44eb-a533-f84976d1dc2e tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-e34ddae7-af0f-4539-a2d0-cfae5670a501-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d0551e68-880d-400f-b176-abeaca556af9 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "cinder-78163cab-b2bd-4835-8b09-59e5370987dc-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d0551e68-880d-400f-b176-abeaca556af9 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-78163cab-b2bd-4835-8b09-59e5370987dc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d0551e68-880d-400f-b176-abeaca556af9 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "cinder-quobyte-78163cab-b2bd-4835-8b09-59e5370987dc" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d0551e68-880d-400f-b176-abeaca556af9 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-quobyte-78163cab-b2bd-4835-8b09-59e5370987dc" acquired by "delete_volume" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[23201575-a3c9-42e3-a74d-312991c9e43d]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d0551e68-880d-400f-b176-abeaca556af9 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78163cab-b2bd-4835-8b09-59e5370987dc {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Flow 'volume_create_manager' (53d10633-9aca-4034-8677-6f7ea6aab032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a055fc-d40f-40f8-9153-91b38b0fe717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a055fc-d40f-40f8-9153-91b38b0fe717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1637115489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab085ab-eb18-47a6-b90d-812320f91a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65e1072e8254e8d98675301a80cd4ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:25Z,use_quota=True,user_id='30f179f0fc394eb59da3b3a72809f43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b05a41-b7cb-4a88-b90c-e3d6ad157f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b05a41-b7cb-4a88-b90c-e3d6ad157f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86eb178e-151e-4799-8adb-7ca58294b4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86eb178e-151e-4799-8adb-7ca58294b4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ab085ab-eb18-47a6-b90d-812320f91a01', 'volume_name': 'volume-3ab085ab-eb18-47a6-b90d-812320f91a01', 'volume_size': 2}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a8c73e-6e97-47d4-bd2f-3a8d330056ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a8c73e-6e97-47d4-bd2f-3a8d330056ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8663e2a3-7e10-4165-9fd6-a259e7937e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:25 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78163cab-b2bd-4835-8b09-59e5370987dc Feb 27 02:09:25 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Volume 3ab085ab-eb18-47a6-b90d-812320f91a01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ab085ab-eb18-47a6-b90d-812320f91a01', 'volume_size': 2} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:25 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1637115489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab085ab-eb18-47a6-b90d-812320f91a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65e1072e8254e8d98675301a80cd4ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:25Z,use_quota=True,user_id='30f179f0fc394eb59da3b3a72809f43e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Creating volume 3ab085ab-eb18-47a6-b90d-812320f91a01 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:25 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01 2147483648 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:25 devstack sudo[89594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01 2147483648 Feb 27 02:09:25 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:25 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d0551e68-880d-400f-b176-abeaca556af9 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78163cab-b2bd-4835-8b09-59e5370987dc" returned: 0 in 0.626s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d0551e68-880d-400f-b176-abeaca556af9 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78163cab-b2bd-4835-8b09-59e5370987dc {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:25 devstack sudo[89602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78163cab-b2bd-4835-8b09-59e5370987dc Feb 27 02:09:25 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:26 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01 2147483648" returned: 0 in 0.559s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:26 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01 Feb 27 02:09:26 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:26 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d0551e68-880d-400f-b176-abeaca556af9 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78163cab-b2bd-4835-8b09-59e5370987dc" returned: 0 in 0.467s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:26 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d0551e68-880d-400f-b176-abeaca556af9 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-quobyte-78163cab-b2bd-4835-8b09-59e5370987dc" released by "delete_volume" :: held 1.148s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:26 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-d0551e68-880d-400f-b176-abeaca556af9 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Created reservations ['b08dc19d-44c1-47b6-843b-86be4cd1cdff', 'bc61cd06-34f9-4527-9845-ffe611df88d1', '1198c360-62c8-4950-92cd-697498968993', '75295661-0471-4c37-8bdf-b988cd46ac87'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:26 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01" returned: 0 in 0.471s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:26 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8663e2a3-7e10-4165-9fd6-a259e7937e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ab085ab-eb18-47a6-b90d-812320f91a01', 'volume_size': 2}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf9a349-3152-4aa8-b5ba-ac1006ac49cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:26 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Volume volume-3ab085ab-eb18-47a6-b90d-812320f91a01 (3ab085ab-eb18-47a6-b90d-812320f91a01): created successfully Feb 27 02:09:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf9a349-3152-4aa8-b5ba-ac1006ac49cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:26 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Flow 'volume_create_manager' (53d10633-9aca-4034-8677-6f7ea6aab032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d0551e68-880d-400f-b176-abeaca556af9 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d0551e68-880d-400f-b176-abeaca556af9 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:26 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d0551e68-880d-400f-b176-abeaca556af9 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:26 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d0551e68-880d-400f-b176-abeaca556af9 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d0551e68-880d-400f-b176-abeaca556af9 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d0551e68-880d-400f-b176-abeaca556af9 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:26 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-53f2e847-7ee6-401a-b57e-2ca329d8d9ee tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Created volume successfully. Feb 27 02:09:26 devstack sudo[89608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:09:26 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:26 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d0551e68-880d-400f-b176-abeaca556af9 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.436s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:26 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-d0551e68-880d-400f-b176-abeaca556af9 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:26 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-d0551e68-880d-400f-b176-abeaca556af9 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Deleted volume successfully. Feb 27 02:09:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d0551e68-880d-400f-b176-abeaca556af9 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-78163cab-b2bd-4835-8b09-59e5370987dc-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-099c1755-5177-43a5-aa62-9fa1deae46a6 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "cinder-0ee0ac2c-f03e-4f52-8923-de0bc14c570a-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-099c1755-5177-43a5-aa62-9fa1deae46a6 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-0ee0ac2c-f03e-4f52-8923-de0bc14c570a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-099c1755-5177-43a5-aa62-9fa1deae46a6 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "cinder-quobyte-0ee0ac2c-f03e-4f52-8923-de0bc14c570a" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-099c1755-5177-43a5-aa62-9fa1deae46a6 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-quobyte-0ee0ac2c-f03e-4f52-8923-de0bc14c570a" acquired by "delete_volume" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:27 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd55b20e-c978-4501-8e1f-569117593dbd]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-099c1755-5177-43a5-aa62-9fa1deae46a6 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0ee0ac2c-f03e-4f52-8923-de0bc14c570a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:27 devstack sudo[89611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0ee0ac2c-f03e-4f52-8923-de0bc14c570a Feb 27 02:09:27 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0010e62a-274a-4f3c-a6e2-522ffd2d90eb tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0010e62a-274a-4f3c-a6e2-522ffd2d90eb tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-0010e62a-274a-4f3c-a6e2-522ffd2d90eb tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Creating offline snapshot 4ac8ebfb-d472-4a31-8692-b5a12aebf239 of volume 3ab085ab-eb18-47a6-b90d-812320f91a01 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:09:27 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[e076f923-bab3-405c-b695-dfd21342db9f]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0010e62a-274a-4f3c-a6e2-522ffd2d90eb tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:27 devstack sudo[89613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01 Feb 27 02:09:27 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:28 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-099c1755-5177-43a5-aa62-9fa1deae46a6 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0ee0ac2c-f03e-4f52-8923-de0bc14c570a" returned: 0 in 0.535s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-099c1755-5177-43a5-aa62-9fa1deae46a6 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0ee0ac2c-f03e-4f52-8923-de0bc14c570a {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:28 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0ee0ac2c-f03e-4f52-8923-de0bc14c570a Feb 27 02:09:28 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:28 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0010e62a-274a-4f3c-a6e2-522ffd2d90eb tempest-VolumesSnapshotNegativeTestJSON-60729927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01" returned: 0 in 0.542s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0010e62a-274a-4f3c-a6e2-522ffd2d90eb tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.4ac8ebfb-d472-4a31-8692-b5a12aebf239 2G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:28 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.4ac8ebfb-d472-4a31-8692-b5a12aebf239 2G Feb 27 02:09:28 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:28 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-099c1755-5177-43a5-aa62-9fa1deae46a6 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0ee0ac2c-f03e-4f52-8923-de0bc14c570a" returned: 0 in 0.456s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:28 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-099c1755-5177-43a5-aa62-9fa1deae46a6 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-quobyte-0ee0ac2c-f03e-4f52-8923-de0bc14c570a" released by "delete_volume" :: held 1.029s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:28 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-099c1755-5177-43a5-aa62-9fa1deae46a6 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Created reservations ['338fa3b1-c14d-41af-83db-e866d19ec4ed', 'ac2c4f45-c712-476e-a0b2-b12e7ccfeddc', 'da75851c-e244-4646-b229-d4ca631b058c', 'e66985a0-65ab-49c8-aa93-0d26a932085c'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-099c1755-5177-43a5-aa62-9fa1deae46a6 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-099c1755-5177-43a5-aa62-9fa1deae46a6 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:28 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-099c1755-5177-43a5-aa62-9fa1deae46a6 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:28 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-099c1755-5177-43a5-aa62-9fa1deae46a6 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-099c1755-5177-43a5-aa62-9fa1deae46a6 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-099c1755-5177-43a5-aa62-9fa1deae46a6 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:28 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:09:28 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:28 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0010e62a-274a-4f3c-a6e2-522ffd2d90eb tempest-VolumesSnapshotNegativeTestJSON-60729927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.4ac8ebfb-d472-4a31-8692-b5a12aebf239 2G" returned: 0 in 0.553s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0010e62a-274a-4f3c-a6e2-522ffd2d90eb tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ab085ab-eb18-47a6-b90d-812320f91a01 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.4ac8ebfb-d472-4a31-8692-b5a12aebf239 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:28 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ab085ab-eb18-47a6-b90d-812320f91a01 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.4ac8ebfb-d472-4a31-8692-b5a12aebf239 Feb 27 02:09:28 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:29 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-099c1755-5177-43a5-aa62-9fa1deae46a6 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.429s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:29 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-099c1755-5177-43a5-aa62-9fa1deae46a6 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:29 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-099c1755-5177-43a5-aa62-9fa1deae46a6 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Deleted volume successfully. Feb 27 02:09:29 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-099c1755-5177-43a5-aa62-9fa1deae46a6 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-0ee0ac2c-f03e-4f52-8923-de0bc14c570a-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:29 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0010e62a-274a-4f3c-a6e2-522ffd2d90eb tempest-VolumesSnapshotNegativeTestJSON-60729927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ab085ab-eb18-47a6-b90d-812320f91a01 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.4ac8ebfb-d472-4a31-8692-b5a12aebf239" returned: 0 in 0.452s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:29 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-0010e62a-274a-4f3c-a6e2-522ffd2d90eb tempest-VolumesSnapshotNegativeTestJSON-60729927 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.4ac8ebfb-d472-4a31-8692-b5a12aebf239 is being set with open permissions: ugo+rw Feb 27 02:09:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0010e62a-274a-4f3c-a6e2-522ffd2d90eb tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.4ac8ebfb-d472-4a31-8692-b5a12aebf239 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:29 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.4ac8ebfb-d472-4a31-8692-b5a12aebf239 Feb 27 02:09:29 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:29 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-94892459-616d-448e-adfe-e7bb96bb4668 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "cinder-9999153c-5588-439a-9e12-1ca882d51c54-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:29 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0010e62a-274a-4f3c-a6e2-522ffd2d90eb tempest-VolumesSnapshotNegativeTestJSON-60729927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.4ac8ebfb-d472-4a31-8692-b5a12aebf239" returned: 0 in 0.441s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:29 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-94892459-616d-448e-adfe-e7bb96bb4668 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-9999153c-5588-439a-9e12-1ca882d51c54-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:29 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-94892459-616d-448e-adfe-e7bb96bb4668 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "cinder-quobyte-9999153c-5588-439a-9e12-1ca882d51c54" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0010e62a-274a-4f3c-a6e2-522ffd2d90eb tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:29 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-94892459-616d-448e-adfe-e7bb96bb4668 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-quobyte-9999153c-5588-439a-9e12-1ca882d51c54" acquired by "delete_volume" :: waited 0.022s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:29 devstack sudo[89641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.info Feb 27 02:09:29 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:29 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b456779-8fb7-46bd-9fff-93111bc84dca]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-94892459-616d-448e-adfe-e7bb96bb4668 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9999153c-5588-439a-9e12-1ca882d51c54 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:29 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9999153c-5588-439a-9e12-1ca882d51c54 Feb 27 02:09:29 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:30 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0010e62a-274a-4f3c-a6e2-522ffd2d90eb tempest-VolumesSnapshotNegativeTestJSON-60729927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.info" returned: 0 in 0.431s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:30 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-0010e62a-274a-4f3c-a6e2-522ffd2d90eb tempest-VolumesSnapshotNegativeTestJSON-60729927 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.info is being set with open permissions: ugo+rw Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0010e62a-274a-4f3c-a6e2-522ffd2d90eb tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:30 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.info Feb 27 02:09:30 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:30 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-94892459-616d-448e-adfe-e7bb96bb4668 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9999153c-5588-439a-9e12-1ca882d51c54" returned: 0 in 0.497s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-94892459-616d-448e-adfe-e7bb96bb4668 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9999153c-5588-439a-9e12-1ca882d51c54 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:30 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9999153c-5588-439a-9e12-1ca882d51c54 Feb 27 02:09:30 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:30 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0010e62a-274a-4f3c-a6e2-522ffd2d90eb tempest-VolumesSnapshotNegativeTestJSON-60729927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.info" returned: 0 in 0.449s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0010e62a-274a-4f3c-a6e2-522ffd2d90eb tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.967s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:30 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-0010e62a-274a-4f3c-a6e2-522ffd2d90eb tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Create snapshot completed successfully Feb 27 02:09:30 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-94892459-616d-448e-adfe-e7bb96bb4668 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9999153c-5588-439a-9e12-1ca882d51c54" returned: 0 in 0.445s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-94892459-616d-448e-adfe-e7bb96bb4668 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-quobyte-9999153c-5588-439a-9e12-1ca882d51c54" released by "delete_volume" :: held 0.967s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-94892459-616d-448e-adfe-e7bb96bb4668 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Created reservations ['b8898755-fe2b-4120-bda7-930027fd065b', '88997ccd-5fcd-492b-a686-5a64a0eb1072', 'eee9b59e-4b2e-44c0-8ba4-b86f9ddcef74', 'f5661de6-970a-432b-b397-a0547abfcc74'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-94892459-616d-448e-adfe-e7bb96bb4668 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-94892459-616d-448e-adfe-e7bb96bb4668 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-94892459-616d-448e-adfe-e7bb96bb4668 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-94892459-616d-448e-adfe-e7bb96bb4668 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-94892459-616d-448e-adfe-e7bb96bb4668 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-94892459-616d-448e-adfe-e7bb96bb4668 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:30 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:09:30 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Acquiring lock "cinder-4ac8ebfb-d472-4a31-8692-b5a12aebf239-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Lock "cinder-4ac8ebfb-d472-4a31-8692-b5a12aebf239-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Acquiring lock "cinder-quobyte-3ab085ab-eb18-47a6-b90d-812320f91a01" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Lock "cinder-quobyte-3ab085ab-eb18-47a6-b90d-812320f91a01" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Acquiring lock "cinder-quobyte-4ac8ebfb-d472-4a31-8692-b5a12aebf239" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Lock "cinder-quobyte-4ac8ebfb-d472-4a31-8692-b5a12aebf239" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Deleting offline snapshot 4ac8ebfb-d472-4a31-8692-b5a12aebf239 of volume 3ab085ab-eb18-47a6-b90d-812320f91a01 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] snapshot_file for this snap is: volume-3ab085ab-eb18-47a6-b90d-812320f91a01.4ac8ebfb-d472-4a31-8692-b5a12aebf239 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aca8b58-caa3-4cce-bd7d-1af52ed38663]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.4ac8ebfb-d472-4a31-8692-b5a12aebf239 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:30 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.4ac8ebfb-d472-4a31-8692-b5a12aebf239 Feb 27 02:09:30 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:31 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-94892459-616d-448e-adfe-e7bb96bb4668 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.443s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:31 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-94892459-616d-448e-adfe-e7bb96bb4668 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:31 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-94892459-616d-448e-adfe-e7bb96bb4668 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Deleted volume successfully. Feb 27 02:09:31 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-94892459-616d-448e-adfe-e7bb96bb4668 tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-9999153c-5588-439a-9e12-1ca882d51c54-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:31 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.4ac8ebfb-d472-4a31-8692-b5a12aebf239" returned: 0 in 0.527s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:31 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ab085ab-eb18-47a6-b90d-812320f91a01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:31 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2b5409-26b1-42ce-bb50-f3dd7fb6a4a0]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:31 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01 Feb 27 02:09:31 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:31 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-414e018b-6d5e-47cf-8881-7c7f3f62abcb tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "cinder-bec8eb08-e8fd-41c6-a79b-304ce7e8786f-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:31 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-414e018b-6d5e-47cf-8881-7c7f3f62abcb tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-bec8eb08-e8fd-41c6-a79b-304ce7e8786f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:31 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-414e018b-6d5e-47cf-8881-7c7f3f62abcb tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "cinder-quobyte-bec8eb08-e8fd-41c6-a79b-304ce7e8786f" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:31 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-414e018b-6d5e-47cf-8881-7c7f3f62abcb tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-quobyte-bec8eb08-e8fd-41c6-a79b-304ce7e8786f" acquired by "delete_volume" :: waited 0.008s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:31 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9735554-ea21-4451-abc3-888a4a04710f]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-414e018b-6d5e-47cf-8881-7c7f3f62abcb tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bec8eb08-e8fd-41c6-a79b-304ce7e8786f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:31 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01" returned: 0 in 0.543s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.4ac8ebfb-d472-4a31-8692-b5a12aebf239 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:32 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.4ac8ebfb-d472-4a31-8692-b5a12aebf239 Feb 27 02:09:32 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:32 devstack sudo[89668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bec8eb08-e8fd-41c6-a79b-304ce7e8786f Feb 27 02:09:32 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:32 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-414e018b-6d5e-47cf-8881-7c7f3f62abcb tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bec8eb08-e8fd-41c6-a79b-304ce7e8786f" returned: 0 in 0.534s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-414e018b-6d5e-47cf-8881-7c7f3f62abcb tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bec8eb08-e8fd-41c6-a79b-304ce7e8786f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:32 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bec8eb08-e8fd-41c6-a79b-304ce7e8786f Feb 27 02:09:32 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:32 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.4ac8ebfb-d472-4a31-8692-b5a12aebf239" returned: 0 in 0.525s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.4ac8ebfb-d472-4a31-8692-b5a12aebf239 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:32 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.4ac8ebfb-d472-4a31-8692-b5a12aebf239 Feb 27 02:09:32 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:32 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-414e018b-6d5e-47cf-8881-7c7f3f62abcb tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bec8eb08-e8fd-41c6-a79b-304ce7e8786f" returned: 0 in 0.456s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:32 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-414e018b-6d5e-47cf-8881-7c7f3f62abcb tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-quobyte-bec8eb08-e8fd-41c6-a79b-304ce7e8786f" released by "delete_volume" :: held 1.019s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:32 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01.4ac8ebfb-d472-4a31-8692-b5a12aebf239" returned: 0 in 0.445s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:32 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-414e018b-6d5e-47cf-8881-7c7f3f62abcb tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Created reservations ['c108208a-40a8-45e5-b08e-14deacf2d055', '9e353723-0c59-4374-9f6d-e7d9307f10c9', '5b5be1ec-fa5d-4ddd-ab42-34dcdde4441c', 'ca213e6d-b364-49a4-9de8-ada9f37d14a5'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Lock "cinder-quobyte-4ac8ebfb-d472-4a31-8692-b5a12aebf239" released by "_delete_snapshot" :: held 2.130s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Lock "cinder-quobyte-3ab085ab-eb18-47a6-b90d-812320f91a01" released by "delete_snapshot" :: held 2.151s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-414e018b-6d5e-47cf-8881-7c7f3f62abcb tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-414e018b-6d5e-47cf-8881-7c7f3f62abcb tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:33 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-414e018b-6d5e-47cf-8881-7c7f3f62abcb tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:33 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-414e018b-6d5e-47cf-8881-7c7f3f62abcb tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-414e018b-6d5e-47cf-8881-7c7f3f62abcb tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-414e018b-6d5e-47cf-8881-7c7f3f62abcb tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:33 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:09:33 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:33 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Created reservations ['fb7db0f9-ab6c-4284-b94c-3afc080c5aa8', '5f1b6f7b-bdda-4a08-80ec-2373ac288fd3', '380329ef-19bf-4589-b563-891b86e8555b', '64f1a895-ee6a-45a8-aaf2-c653b646aec4'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:33 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Delete snapshot completed successfully. Feb 27 02:09:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-115b1f84-1f2e-42a4-8f7d-a7f722f21e71 tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Lock "cinder-4ac8ebfb-d472-4a31-8692-b5a12aebf239-delete_snapshot" released by "delete_snapshot" :: held 2.283s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:33 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-414e018b-6d5e-47cf-8881-7c7f3f62abcb tempest-CreateVolumesFromSourceVolumeTest-174636311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.480s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:33 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-414e018b-6d5e-47cf-8881-7c7f3f62abcb tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:33 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-414e018b-6d5e-47cf-8881-7c7f3f62abcb tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Deleted volume successfully. Feb 27 02:09:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-414e018b-6d5e-47cf-8881-7c7f3f62abcb tempest-CreateVolumesFromSourceVolumeTest-174636311 None] Lock "cinder-bec8eb08-e8fd-41c6-a79b-304ce7e8786f-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:34 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d489fac9-05ae-40ad-9515-32fc9b53586a tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Acquiring lock "cinder-3ab085ab-eb18-47a6-b90d-812320f91a01-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:34 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d489fac9-05ae-40ad-9515-32fc9b53586a tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Lock "cinder-3ab085ab-eb18-47a6-b90d-812320f91a01-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:34 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d489fac9-05ae-40ad-9515-32fc9b53586a tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Acquiring lock "cinder-quobyte-3ab085ab-eb18-47a6-b90d-812320f91a01" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:34 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d489fac9-05ae-40ad-9515-32fc9b53586a tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Lock "cinder-quobyte-3ab085ab-eb18-47a6-b90d-812320f91a01" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:34 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a41582a-f069-497e-9e7d-558f3b0b8590]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d489fac9-05ae-40ad-9515-32fc9b53586a tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:34 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01 Feb 27 02:09:34 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:34 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d489fac9-05ae-40ad-9515-32fc9b53586a tempest-VolumesSnapshotNegativeTestJSON-60729927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01" returned: 0 in 0.566s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d489fac9-05ae-40ad-9515-32fc9b53586a tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:34 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01 Feb 27 02:09:34 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:35 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d489fac9-05ae-40ad-9515-32fc9b53586a tempest-VolumesSnapshotNegativeTestJSON-60729927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3ab085ab-eb18-47a6-b90d-812320f91a01" returned: 0 in 0.517s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:35 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d489fac9-05ae-40ad-9515-32fc9b53586a tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Lock "cinder-quobyte-3ab085ab-eb18-47a6-b90d-812320f91a01" released by "delete_volume" :: held 1.115s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:35 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-d489fac9-05ae-40ad-9515-32fc9b53586a tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Created reservations ['0985d12f-8bd3-45a0-94c9-80a15c5d2fec', '5143d307-3742-468e-8013-4fdf01eb4ead', '2a214ba1-05e2-481d-93d0-c7279935079a', 'ac1d836f-c0bb-4fa5-bc4a-c2e2c5d74d3d'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d489fac9-05ae-40ad-9515-32fc9b53586a tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d489fac9-05ae-40ad-9515-32fc9b53586a tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:35 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d489fac9-05ae-40ad-9515-32fc9b53586a tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:35 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d489fac9-05ae-40ad-9515-32fc9b53586a tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d489fac9-05ae-40ad-9515-32fc9b53586a tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d489fac9-05ae-40ad-9515-32fc9b53586a tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:35 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:09:35 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:35 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d489fac9-05ae-40ad-9515-32fc9b53586a tempest-VolumesSnapshotNegativeTestJSON-60729927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.470s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:35 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-d489fac9-05ae-40ad-9515-32fc9b53586a tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:35 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-d489fac9-05ae-40ad-9515-32fc9b53586a tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Deleted volume successfully. Feb 27 02:09:35 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d489fac9-05ae-40ad-9515-32fc9b53586a tempest-VolumesSnapshotNegativeTestJSON-60729927 None] Lock "cinder-3ab085ab-eb18-47a6-b90d-812320f91a01-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Flow 'volume_create_manager' (d024cd59-935e-4573-9ece-5c46bb579848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caea6c38-f055-4111-b64b-89d2d919b408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caea6c38-f055-4111-b64b-89d2d919b408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6652df86-9c70-4696-b5dc-41651e498491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db82fa642a4847f3a6b37dcd7d1cb134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:36Z,use_quota=True,user_id='0e9537de54be4292a6dc2526c62c3db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96f66cc2-9bd2-42fd-9fef-01d65109c75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96f66cc2-9bd2-42fd-9fef-01d65109c75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7be9fc3-565d-4501-8488-bd7441bbbe9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7be9fc3-565d-4501-8488-bd7441bbbe9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6652df86-9c70-4696-b5dc-41651e498491', 'volume_name': 'volume-6652df86-9c70-4696-b5dc-41651e498491', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4c376d-85c5-4079-a94f-86a0ad6f5391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4c376d-85c5-4079-a94f-86a0ad6f5391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f4178d-71a1-4217-b629-f803739219cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:36 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Volume 6652df86-9c70-4696-b5dc-41651e498491: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6652df86-9c70-4696-b5dc-41651e498491', 'volume_size': 1} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6652df86-9c70-4696-b5dc-41651e498491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db82fa642a4847f3a6b37dcd7d1cb134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:36Z,use_quota=True,user_id='0e9537de54be4292a6dc2526c62c3db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Creating volume 6652df86-9c70-4696-b5dc-41651e498491 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:36 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6652df86-9c70-4696-b5dc-41651e498491 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:36 devstack sudo[89698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6652df86-9c70-4696-b5dc-41651e498491 1073741824 Feb 27 02:09:36 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:36 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6652df86-9c70-4696-b5dc-41651e498491 1073741824" returned: 0 in 0.587s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6652df86-9c70-4696-b5dc-41651e498491 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:36 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6652df86-9c70-4696-b5dc-41651e498491 Feb 27 02:09:36 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:37 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6652df86-9c70-4696-b5dc-41651e498491" returned: 0 in 0.606s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:37 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:37 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f4178d-71a1-4217-b629-f803739219cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6652df86-9c70-4696-b5dc-41651e498491', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:37 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347afba9-4585-4fbb-9ff6-37f233810773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:37 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Volume volume-6652df86-9c70-4696-b5dc-41651e498491 (6652df86-9c70-4696-b5dc-41651e498491): created successfully Feb 27 02:09:37 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347afba9-4585-4fbb-9ff6-37f233810773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:37 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Flow 'volume_create_manager' (d024cd59-935e-4573-9ece-5c46bb579848) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:37 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-6938a898-ad7b-4a2e-b001-dd491565bd8c tempest-CinderUnicodeTest-83435341 None] Created volume successfully. Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Flow 'volume_create_manager' (121cf13b-9a21-437b-a062-aa35eef0b89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3278bf-4557-4c49-99ab-024636ea818d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3278bf-4557-4c49-99ab-024636ea818d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1096794839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b47dadaf1ba4fb8af8530605897d37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:38Z,use_quota=True,user_id='7675d9d7def243229ea1fc12a5c2c883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec6b376-9218-4016-bc43-3087d5d08aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec6b376-9218-4016-bc43-3087d5d08aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b5cd10-af24-4756-915f-35aaa249d225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b5cd10-af24-4756-915f-35aaa249d225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d', 'volume_name': 'volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad528393-f388-46c5-aebb-b4c8b3ae298e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad528393-f388-46c5-aebb-b4c8b3ae298e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341ab740-5303-49ee-b0f1-50354cc9cc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:38 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Volume 9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d', 'volume_size': 1} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1096794839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b47dadaf1ba4fb8af8530605897d37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:38Z,use_quota=True,user_id='7675d9d7def243229ea1fc12a5c2c883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Creating volume 9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:38 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:38 devstack sudo[89708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d 1073741824 Feb 27 02:09:38 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Flow 'volume_create_manager' (550d9418-642b-4c69-8dd6-07498ce252ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8057543b-42c5-43b0-9be2-2c612fcff244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8057543b-42c5-43b0-9be2-2c612fcff244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1793679391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7947c885-5f9f-4c9e-b6fc-91c51346b814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db82fa642a4847f3a6b37dcd7d1cb134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:39Z,use_quota=True,user_id='0e9537de54be4292a6dc2526c62c3db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b9a502-f093-438c-bc95-72776ea17b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0b9a502-f093-438c-bc95-72776ea17b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6d43bc-c484-4bbc-baaf-9b622ea26542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6d43bc-c484-4bbc-baaf-9b622ea26542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7947c885-5f9f-4c9e-b6fc-91c51346b814', 'volume_name': 'volume-7947c885-5f9f-4c9e-b6fc-91c51346b814', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93852ea0-a093-4119-80c0-b0732b7d28c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93852ea0-a093-4119-80c0-b0732b7d28c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (290e8923-baaa-4710-a5b9-e235d88bca70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:38 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Volume 7947c885-5f9f-4c9e-b6fc-91c51346b814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7947c885-5f9f-4c9e-b6fc-91c51346b814', 'volume_size': 1} Feb 27 02:09:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:39 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d 1073741824" returned: 0 in 0.524s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:39 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d Feb 27 02:09:39 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:39 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d" returned: 0 in 0.484s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:39 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.949s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:39 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1793679391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7947c885-5f9f-4c9e-b6fc-91c51346b814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db82fa642a4847f3a6b37dcd7d1cb134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:39Z,use_quota=True,user_id='0e9537de54be4292a6dc2526c62c3db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:39 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Creating volume 7947c885-5f9f-4c9e-b6fc-91c51346b814 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:39 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:39 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:39 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:39 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:09:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:39 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341ab740-5303-49ee-b0f1-50354cc9cc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:39 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015c7e47-9868-4c31-b606-735e130faee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:39 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814 1073741824 Feb 27 02:09:39 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:39 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Volume volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d (9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d): created successfully Feb 27 02:09:39 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015c7e47-9868-4c31-b606-735e130faee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:39 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Flow 'volume_create_manager' (121cf13b-9a21-437b-a062-aa35eef0b89c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:39 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-fb8d2d7a-10e7-4c14-abb3-2891384427c6 tempest-CreateVolumesFromSnapshotTest-228703118 None] Created volume successfully. Feb 27 02:09:40 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814 1073741824" returned: 0 in 0.558s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:40 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814 Feb 27 02:09:40 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:40 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814" returned: 0 in 0.472s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:40 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:40 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (290e8923-baaa-4710-a5b9-e235d88bca70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7947c885-5f9f-4c9e-b6fc-91c51346b814', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:40 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443b7b40-f63c-4120-b5b3-3aea38d5ac08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:40 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Volume volume-7947c885-5f9f-4c9e-b6fc-91c51346b814 (7947c885-5f9f-4c9e-b6fc-91c51346b814): created successfully Feb 27 02:09:40 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443b7b40-f63c-4120-b5b3-3aea38d5ac08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:40 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Flow 'volume_create_manager' (550d9418-642b-4c69-8dd6-07498ce252ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:40 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-30d25ca6-d929-40c4-936a-ebedd68e5893 tempest-CinderUnicodeTest-83435341 None] Created volume successfully. Feb 27 02:09:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a100d208-7666-4d8e-bdef-91967f01e577 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a100d208-7666-4d8e-bdef-91967f01e577 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:40 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-a100d208-7666-4d8e-bdef-91967f01e577 tempest-CreateVolumesFromSnapshotTest-228703118 None] Creating offline snapshot c729f600-82a3-4b79-a5f4-86bfd727cd70 of volume 9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:09:40 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36faaa6-f2cb-4e84-b637-79c8b7bca656]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a100d208-7666-4d8e-bdef-91967f01e577 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:40 devstack sudo[89724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d Feb 27 02:09:40 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:41 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a100d208-7666-4d8e-bdef-91967f01e577 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d" returned: 0 in 0.497s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a100d208-7666-4d8e-bdef-91967f01e577 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.c729f600-82a3-4b79-a5f4-86bfd727cd70 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:41 devstack sudo[89729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.c729f600-82a3-4b79-a5f4-86bfd727cd70 1G Feb 27 02:09:41 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:41 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a100d208-7666-4d8e-bdef-91967f01e577 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.c729f600-82a3-4b79-a5f4-86bfd727cd70 1G" returned: 0 in 0.549s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a100d208-7666-4d8e-bdef-91967f01e577 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.c729f600-82a3-4b79-a5f4-86bfd727cd70 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:41 devstack sudo[89734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.c729f600-82a3-4b79-a5f4-86bfd727cd70 Feb 27 02:09:41 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-42c2e96d-ffe4-4a0f-88f4-d2ef807dcf11 tempest-CinderUnicodeTest-83435341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:42 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a100d208-7666-4d8e-bdef-91967f01e577 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.c729f600-82a3-4b79-a5f4-86bfd727cd70" returned: 0 in 0.478s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:42 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-a100d208-7666-4d8e-bdef-91967f01e577 tempest-CreateVolumesFromSnapshotTest-228703118 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.c729f600-82a3-4b79-a5f4-86bfd727cd70 is being set with open permissions: ugo+rw Feb 27 02:09:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a100d208-7666-4d8e-bdef-91967f01e577 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.c729f600-82a3-4b79-a5f4-86bfd727cd70 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:42 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.c729f600-82a3-4b79-a5f4-86bfd727cd70 Feb 27 02:09:42 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:42 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a100d208-7666-4d8e-bdef-91967f01e577 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.c729f600-82a3-4b79-a5f4-86bfd727cd70" returned: 0 in 0.448s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a100d208-7666-4d8e-bdef-91967f01e577 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:42 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.info Feb 27 02:09:42 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:43 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a100d208-7666-4d8e-bdef-91967f01e577 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.info" returned: 0 in 0.478s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:43 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-a100d208-7666-4d8e-bdef-91967f01e577 tempest-CreateVolumesFromSnapshotTest-228703118 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.info is being set with open permissions: ugo+rw Feb 27 02:09:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a100d208-7666-4d8e-bdef-91967f01e577 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:43 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.info Feb 27 02:09:43 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:43 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a100d208-7666-4d8e-bdef-91967f01e577 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.info" returned: 0 in 0.426s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a100d208-7666-4d8e-bdef-91967f01e577 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.938s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-42c2e96d-ffe4-4a0f-88f4-d2ef807dcf11 tempest-CinderUnicodeTest-83435341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.833s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:43 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-42c2e96d-ffe4-4a0f-88f4-d2ef807dcf11 tempest-CinderUnicodeTest-83435341 None] Creating offline snapshot 0e213b9b-c869-4760-adaf-4a026b3da5fc of volume 7947c885-5f9f-4c9e-b6fc-91c51346b814 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:09:43 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-a100d208-7666-4d8e-bdef-91967f01e577 tempest-CreateVolumesFromSnapshotTest-228703118 None] Create snapshot completed successfully Feb 27 02:09:43 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c63d2c-9419-48cd-968e-9ed71c4991e7]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-42c2e96d-ffe4-4a0f-88f4-d2ef807dcf11 tempest-CinderUnicodeTest-83435341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:43 devstack sudo[89748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814 Feb 27 02:09:43 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Flow 'volume_create_manager' (3785e489-57be-42e4-82d1-4f7d8a21154b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6697df3d-1c25-45f2-8168-5f28362293cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6697df3d-1c25-45f2-8168-5f28362293cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1935039633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b47dadaf1ba4fb8af8530605897d37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:44Z,use_quota=True,user_id='7675d9d7def243229ea1fc12a5c2c883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0084463-a0d8-483d-94c9-ea38897610c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0084463-a0d8-483d-94c9-ea38897610c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83a3919-991b-44ba-8408-6a3554447d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83a3919-991b-44ba-8408-6a3554447d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f', 'volume_name': 'volume-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619187d8-2e39-4e7e-aca6-831165e530ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619187d8-2e39-4e7e-aca6-831165e530ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d8e7ff-276c-4cb0-bbd1-a0bf5398460e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Volume b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f', 'volume_size': 1} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:44 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-42c2e96d-ffe4-4a0f-88f4-d2ef807dcf11 tempest-CinderUnicodeTest-83435341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814" returned: 0 in 0.565s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-42c2e96d-ffe4-4a0f-88f4-d2ef807dcf11 tempest-CinderUnicodeTest-83435341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.0e213b9b-c869-4760-adaf-4a026b3da5fc 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:44 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.0e213b9b-c869-4760-adaf-4a026b3da5fc 1G Feb 27 02:09:44 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Flow 'volume_create_manager' (b6c6a44e-d2e5-40e2-aadc-61ae7d76113b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (441efbd7-021e-4bb0-ad9d-71fdf5465a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (441efbd7-021e-4bb0-ad9d-71fdf5465a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-992596423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ed4118-3ddc-4248-a438-8a9d26361d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b47dadaf1ba4fb8af8530605897d37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:44Z,use_quota=True,user_id='7675d9d7def243229ea1fc12a5c2c883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd00fef-e25d-4afd-8843-ec4f6e111201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd00fef-e25d-4afd-8843-ec4f6e111201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06125260-6711-41c6-b453-597467264087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06125260-6711-41c6-b453-597467264087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5ed4118-3ddc-4248-a438-8a9d26361d0e', 'volume_name': 'volume-e5ed4118-3ddc-4248-a438-8a9d26361d0e', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27024860-208d-4448-ad19-7fb3c9ffc573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27024860-208d-4448-ad19-7fb3c9ffc573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2dc0fb6-a09f-4b6b-9416-6db0ec6cce37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Volume e5ed4118-3ddc-4248-a438-8a9d26361d0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5ed4118-3ddc-4248-a438-8a9d26361d0e', 'volume_size': 1} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Flow 'volume_create_manager' (88d9285d-393b-4e09-90de-80be53e7dc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e54e8dce-88bb-4c0e-a12a-06210c0e30ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e54e8dce-88bb-4c0e-a12a-06210c0e30ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-483005180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff8dfbf-1506-4fe4-8cf9-05725d795a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b47dadaf1ba4fb8af8530605897d37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:45Z,use_quota=True,user_id='7675d9d7def243229ea1fc12a5c2c883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38348eb0-037d-4002-aac9-bc6b3b3c5810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38348eb0-037d-4002-aac9-bc6b3b3c5810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4095e01b-40b6-4322-8926-1875b23a5098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4095e01b-40b6-4322-8926-1875b23a5098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ff8dfbf-1506-4fe4-8cf9-05725d795a16', 'volume_name': 'volume-7ff8dfbf-1506-4fe4-8cf9-05725d795a16', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fdcc3a9-0bba-4488-a61b-6e4154b27a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fdcc3a9-0bba-4488-a61b-6e4154b27a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf12071-4ba9-4548-87b9-f62d81ba6ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Volume 7ff8dfbf-1506-4fe4-8cf9-05725d795a16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ff8dfbf-1506-4fe4-8cf9-05725d795a16', 'volume_size': 1} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Flow 'volume_create_manager' (23caf802-cf6b-4b55-9858-a5ed9cc965cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0809843-c1e4-42bf-be3f-cc2eb46913f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0809843-c1e4-42bf-be3f-cc2eb46913f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2039978296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a927cb86-bfa4-4522-bd88-d30e48374937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b47dadaf1ba4fb8af8530605897d37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:45Z,use_quota=True,user_id='7675d9d7def243229ea1fc12a5c2c883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9484c6b4-cd62-4011-b0c5-48032e2a742e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9484c6b4-cd62-4011-b0c5-48032e2a742e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d350c8-aaba-43dc-a5a6-cf89640f8641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d350c8-aaba-43dc-a5a6-cf89640f8641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a927cb86-bfa4-4522-bd88-d30e48374937', 'volume_name': 'volume-a927cb86-bfa4-4522-bd88-d30e48374937', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e0a9ea-3a5a-415c-8cf3-8ff35721047d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e0a9ea-3a5a-415c-8cf3-8ff35721047d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7755625a-17ad-4849-8c02-c808a8f2b667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:44 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Volume a927cb86-bfa4-4522-bd88-d30e48374937: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a927cb86-bfa4-4522-bd88-d30e48374937', 'volume_size': 1} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:44 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-42c2e96d-ffe4-4a0f-88f4-d2ef807dcf11 tempest-CinderUnicodeTest-83435341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.0e213b9b-c869-4760-adaf-4a026b3da5fc 1G" returned: 0 in 0.614s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-42c2e96d-ffe4-4a0f-88f4-d2ef807dcf11 tempest-CinderUnicodeTest-83435341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7947c885-5f9f-4c9e-b6fc-91c51346b814 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.0e213b9b-c869-4760-adaf-4a026b3da5fc {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:45 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7947c885-5f9f-4c9e-b6fc-91c51346b814 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.0e213b9b-c869-4760-adaf-4a026b3da5fc Feb 27 02:09:45 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:45 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:09:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Flow 'volume_create_manager' (5f73579a-d322-4ef9-ada2-792052c1d158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d0ee78-3774-44da-9b04-b42290f88d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d0ee78-3774-44da-9b04-b42290f88d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1186678408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905ca6e5-e1d3-48d4-9a97-2e48722050b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b47dadaf1ba4fb8af8530605897d37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:45Z,use_quota=True,user_id='7675d9d7def243229ea1fc12a5c2c883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1c27de-ba02-4a97-9639-c6b0edfd15e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1c27de-ba02-4a97-9639-c6b0edfd15e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e223d24d-0d48-44ac-9e90-a7c31da03c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e223d24d-0d48-44ac-9e90-a7c31da03c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '905ca6e5-e1d3-48d4-9a97-2e48722050b8', 'volume_name': 'volume-905ca6e5-e1d3-48d4-9a97-2e48722050b8', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01cd7919-92ea-443e-98a3-36f1661e0d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01cd7919-92ea-443e-98a3-36f1661e0d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:45 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9e25c5-82fa-4ba4-b5f1-e9b064cd3a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:45 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Volume 905ca6e5-e1d3-48d4-9a97-2e48722050b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-905ca6e5-e1d3-48d4-9a97-2e48722050b8', 'volume_size': 1} Feb 27 02:09:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:45 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-42c2e96d-ffe4-4a0f-88f4-d2ef807dcf11 tempest-CinderUnicodeTest-83435341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7947c885-5f9f-4c9e-b6fc-91c51346b814 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.0e213b9b-c869-4760-adaf-4a026b3da5fc" returned: 0 in 0.495s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:45 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-42c2e96d-ffe4-4a0f-88f4-d2ef807dcf11 tempest-CinderUnicodeTest-83435341 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.0e213b9b-c869-4760-adaf-4a026b3da5fc is being set with open permissions: ugo+rw Feb 27 02:09:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-42c2e96d-ffe4-4a0f-88f4-d2ef807dcf11 tempest-CinderUnicodeTest-83435341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.0e213b9b-c869-4760-adaf-4a026b3da5fc {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:45 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.0e213b9b-c869-4760-adaf-4a026b3da5fc Feb 27 02:09:45 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:45 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-42c2e96d-ffe4-4a0f-88f4-d2ef807dcf11 tempest-CinderUnicodeTest-83435341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.0e213b9b-c869-4760-adaf-4a026b3da5fc" returned: 0 in 0.418s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-42c2e96d-ffe4-4a0f-88f4-d2ef807dcf11 tempest-CinderUnicodeTest-83435341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:45 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.info Feb 27 02:09:45 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:46 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-42c2e96d-ffe4-4a0f-88f4-d2ef807dcf11 tempest-CinderUnicodeTest-83435341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.info" returned: 0 in 0.464s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:46 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-42c2e96d-ffe4-4a0f-88f4-d2ef807dcf11 tempest-CinderUnicodeTest-83435341 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.info is being set with open permissions: ugo+rw Feb 27 02:09:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-42c2e96d-ffe4-4a0f-88f4-d2ef807dcf11 tempest-CinderUnicodeTest-83435341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:46 devstack sudo[89769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.info Feb 27 02:09:46 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:46 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-42c2e96d-ffe4-4a0f-88f4-d2ef807dcf11 tempest-CinderUnicodeTest-83435341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.info" returned: 0 in 0.451s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-42c2e96d-ffe4-4a0f-88f4-d2ef807dcf11 tempest-CinderUnicodeTest-83435341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.077s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.544s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1935039633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b47dadaf1ba4fb8af8530605897d37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:44Z,use_quota=True,user_id='7675d9d7def243229ea1fc12a5c2c883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Creating volume b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:46 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:09:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:46 devstack sudo[89772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f 1073741824 Feb 27 02:09:46 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:46 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-42c2e96d-ffe4-4a0f-88f4-d2ef807dcf11 tempest-CinderUnicodeTest-83435341 None] Create snapshot completed successfully Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] Acquiring lock "cinder-0e213b9b-c869-4760-adaf-4a026b3da5fc-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] Lock "cinder-0e213b9b-c869-4760-adaf-4a026b3da5fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] Acquiring lock "cinder-quobyte-7947c885-5f9f-4c9e-b6fc-91c51346b814" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] Lock "cinder-quobyte-7947c885-5f9f-4c9e-b6fc-91c51346b814" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] Acquiring lock "cinder-quobyte-0e213b9b-c869-4760-adaf-4a026b3da5fc" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] Lock "cinder-quobyte-0e213b9b-c869-4760-adaf-4a026b3da5fc" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] Deleting offline snapshot 0e213b9b-c869-4760-adaf-4a026b3da5fc of volume 7947c885-5f9f-4c9e-b6fc-91c51346b814 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] snapshot_file for this snap is: volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.0e213b9b-c869-4760-adaf-4a026b3da5fc {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1baebd-46aa-4162-95d5-8edeb90fafc6]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.0e213b9b-c869-4760-adaf-4a026b3da5fc {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:47 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.0e213b9b-c869-4760-adaf-4a026b3da5fc Feb 27 02:09:47 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:47 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f 1073741824" returned: 0 in 0.595s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:47 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f Feb 27 02:09:47 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:47 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.0e213b9b-c869-4760-adaf-4a026b3da5fc" returned: 0 in 0.587s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7947c885-5f9f-4c9e-b6fc-91c51346b814(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba8a4c9-2823-4b50-8aa4-9adba187a413]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:47 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814 Feb 27 02:09:47 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:47 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f" returned: 0 in 0.467s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.450s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-992596423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ed4118-3ddc-4248-a438-8a9d26361d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b47dadaf1ba4fb8af8530605897d37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:44Z,use_quota=True,user_id='7675d9d7def243229ea1fc12a5c2c883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Creating volume e5ed4118-3ddc-4248-a438-8a9d26361d0e {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:47 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e5ed4118-3ddc-4248-a438-8a9d26361d0e 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5d8e7ff-276c-4cb0-bbd1-a0bf5398460e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:47 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e5ed4118-3ddc-4248-a438-8a9d26361d0e 1073741824 Feb 27 02:09:47 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b814469-4ee2-4c6f-8ce7-c74947b777df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:47 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:48 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Volume volume-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f (b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f): created successfully Feb 27 02:09:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b814469-4ee2-4c6f-8ce7-c74947b777df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:48 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Flow 'volume_create_manager' (3785e489-57be-42e4-82d1-4f7d8a21154b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:48 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-720afa39-7058-49ba-b962-6414c3a78875 tempest-CreateVolumesFromSnapshotTest-228703118 None] Created volume successfully. Feb 27 02:09:48 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814" returned: 0 in 0.617s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.0e213b9b-c869-4760-adaf-4a026b3da5fc {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:48 devstack sudo[89796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.0e213b9b-c869-4760-adaf-4a026b3da5fc Feb 27 02:09:48 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:48 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e5ed4118-3ddc-4248-a438-8a9d26361d0e 1073741824" returned: 0 in 0.637s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e5ed4118-3ddc-4248-a438-8a9d26361d0e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:48 devstack sudo[89798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e5ed4118-3ddc-4248-a438-8a9d26361d0e Feb 27 02:09:48 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:48 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.0e213b9b-c869-4760-adaf-4a026b3da5fc" returned: 0 in 0.483s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.0e213b9b-c869-4760-adaf-4a026b3da5fc {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:48 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.0e213b9b-c869-4760-adaf-4a026b3da5fc Feb 27 02:09:48 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:49 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e5ed4118-3ddc-4248-a438-8a9d26361d0e" returned: 0 in 0.439s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.359s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-483005180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff8dfbf-1506-4fe4-8cf9-05725d795a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b47dadaf1ba4fb8af8530605897d37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:45Z,use_quota=True,user_id='7675d9d7def243229ea1fc12a5c2c883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Creating volume 7ff8dfbf-1506-4fe4-8cf9-05725d795a16 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:49 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7ff8dfbf-1506-4fe4-8cf9-05725d795a16 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2dc0fb6-a09f-4b6b-9416-6db0ec6cce37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5ed4118-3ddc-4248-a438-8a9d26361d0e', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:49 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7ff8dfbf-1506-4fe4-8cf9-05725d795a16 1073741824 Feb 27 02:09:49 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0dd61a1-7125-4ddb-856c-a4a0a0090ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:49 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Volume volume-e5ed4118-3ddc-4248-a438-8a9d26361d0e (e5ed4118-3ddc-4248-a438-8a9d26361d0e): created successfully Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0dd61a1-7125-4ddb-856c-a4a0a0090ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Flow 'volume_create_manager' (b6c6a44e-d2e5-40e2-aadc-61ae7d76113b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:49 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-6d17847c-9c4c-4c09-8393-04862d6e6ce3 tempest-CreateVolumesFromSnapshotTest-228703118 None] Created volume successfully. Feb 27 02:09:49 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814.0e213b9b-c869-4760-adaf-4a026b3da5fc" returned: 0 in 0.435s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] Lock "cinder-quobyte-0e213b9b-c869-4760-adaf-4a026b3da5fc" released by "_delete_snapshot" :: held 2.219s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] Lock "cinder-quobyte-7947c885-5f9f-4c9e-b6fc-91c51346b814" released by "delete_snapshot" :: held 2.237s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] Created reservations ['b0d57f88-fcf6-4c34-b20a-544cc64bde92', '1d867b61-31fe-4d90-9a66-2201b9fd87e1', 'f2d099cd-2426-4de5-ad30-c7c4135e7c67', 'f8e799eb-be17-42d5-bc4e-2f89046d8bca'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:49 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] Delete snapshot completed successfully. Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5962f56f-b8d1-4b38-93be-8c284ed00352 tempest-CinderUnicodeTest-83435341 None] Lock "cinder-0e213b9b-c869-4760-adaf-4a026b3da5fc-delete_snapshot" released by "delete_snapshot" :: held 2.368s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:49 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7ff8dfbf-1506-4fe4-8cf9-05725d795a16 1073741824" returned: 0 in 0.544s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7ff8dfbf-1506-4fe4-8cf9-05725d795a16 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:49 devstack sudo[89812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7ff8dfbf-1506-4fe4-8cf9-05725d795a16 Feb 27 02:09:49 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:50 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7ff8dfbf-1506-4fe4-8cf9-05725d795a16" returned: 0 in 0.407s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.117s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2039978296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a927cb86-bfa4-4522-bd88-d30e48374937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b47dadaf1ba4fb8af8530605897d37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:45Z,use_quota=True,user_id='7675d9d7def243229ea1fc12a5c2c883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Creating volume a927cb86-bfa4-4522-bd88-d30e48374937 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:50 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a927cb86-bfa4-4522-bd88-d30e48374937 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf12071-4ba9-4548-87b9-f62d81ba6ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ff8dfbf-1506-4fe4-8cf9-05725d795a16', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:50 devstack sudo[89815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a927cb86-bfa4-4522-bd88-d30e48374937 1073741824 Feb 27 02:09:50 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34218e2-6d23-41c3-8c6b-46c8b69e96d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:50 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Volume volume-7ff8dfbf-1506-4fe4-8cf9-05725d795a16 (7ff8dfbf-1506-4fe4-8cf9-05725d795a16): created successfully Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34218e2-6d23-41c3-8c6b-46c8b69e96d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Flow 'volume_create_manager' (88d9285d-393b-4e09-90de-80be53e7dc70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:50 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-24b4d04d-ca0c-4454-af00-2f34c61721aa tempest-CreateVolumesFromSnapshotTest-228703118 None] Created volume successfully. Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ceb07eda-fe8e-4f3b-b594-c1bab3ef2164 tempest-CinderUnicodeTest-83435341 None] Acquiring lock "cinder-7947c885-5f9f-4c9e-b6fc-91c51346b814-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ceb07eda-fe8e-4f3b-b594-c1bab3ef2164 tempest-CinderUnicodeTest-83435341 None] Lock "cinder-7947c885-5f9f-4c9e-b6fc-91c51346b814-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ceb07eda-fe8e-4f3b-b594-c1bab3ef2164 tempest-CinderUnicodeTest-83435341 None] Acquiring lock "cinder-quobyte-7947c885-5f9f-4c9e-b6fc-91c51346b814" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ceb07eda-fe8e-4f3b-b594-c1bab3ef2164 tempest-CinderUnicodeTest-83435341 None] Lock "cinder-quobyte-7947c885-5f9f-4c9e-b6fc-91c51346b814" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[9628b922-83b7-4812-8587-477bc3d0b70e]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ceb07eda-fe8e-4f3b-b594-c1bab3ef2164 tempest-CinderUnicodeTest-83435341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:50 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814 Feb 27 02:09:50 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:50 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a927cb86-bfa4-4522-bd88-d30e48374937 1073741824" returned: 0 in 0.575s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a927cb86-bfa4-4522-bd88-d30e48374937 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:50 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a927cb86-bfa4-4522-bd88-d30e48374937 Feb 27 02:09:50 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:50 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ceb07eda-fe8e-4f3b-b594-c1bab3ef2164 tempest-CinderUnicodeTest-83435341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814" returned: 0 in 0.522s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ceb07eda-fe8e-4f3b-b594-c1bab3ef2164 tempest-CinderUnicodeTest-83435341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:50 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814 Feb 27 02:09:50 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:51 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a927cb86-bfa4-4522-bd88-d30e48374937" returned: 0 in 0.419s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.851s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1186678408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905ca6e5-e1d3-48d4-9a97-2e48722050b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b47dadaf1ba4fb8af8530605897d37d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:09:45Z,use_quota=True,user_id='7675d9d7def243229ea1fc12a5c2c883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Creating volume 905ca6e5-e1d3-48d4-9a97-2e48722050b8 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:09:51 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-905ca6e5-e1d3-48d4-9a97-2e48722050b8 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7755625a-17ad-4849-8c02-c808a8f2b667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a927cb86-bfa4-4522-bd88-d30e48374937', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d75e167-5ff1-4270-a0f4-4ed472f32118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:51 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-905ca6e5-e1d3-48d4-9a97-2e48722050b8 1073741824 Feb 27 02:09:51 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:51 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Volume volume-a927cb86-bfa4-4522-bd88-d30e48374937 (a927cb86-bfa4-4522-bd88-d30e48374937): created successfully Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d75e167-5ff1-4270-a0f4-4ed472f32118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Flow 'volume_create_manager' (23caf802-cf6b-4b55-9858-a5ed9cc965cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:51 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-9d4fbb91-eeed-4105-beae-613e0ee31817 tempest-CreateVolumesFromSnapshotTest-228703118 None] Created volume successfully. Feb 27 02:09:51 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ceb07eda-fe8e-4f3b-b594-c1bab3ef2164 tempest-CinderUnicodeTest-83435341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7947c885-5f9f-4c9e-b6fc-91c51346b814" returned: 0 in 0.437s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ceb07eda-fe8e-4f3b-b594-c1bab3ef2164 tempest-CinderUnicodeTest-83435341 None] Lock "cinder-quobyte-7947c885-5f9f-4c9e-b6fc-91c51346b814" released by "delete_volume" :: held 0.994s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-ceb07eda-fe8e-4f3b-b594-c1bab3ef2164 tempest-CinderUnicodeTest-83435341 None] Created reservations ['3f389516-f6ef-4af5-b37f-6df05b92aff6', '55248c9b-52d3-4b98-9c3c-99df724c47da', '77848c97-8eb3-4970-9fb0-e2f157fad798', '1c6eb6ba-c90b-4b58-aeef-5e52fceb843b'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ceb07eda-fe8e-4f3b-b594-c1bab3ef2164 tempest-CinderUnicodeTest-83435341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ceb07eda-fe8e-4f3b-b594-c1bab3ef2164 tempest-CinderUnicodeTest-83435341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ceb07eda-fe8e-4f3b-b594-c1bab3ef2164 tempest-CinderUnicodeTest-83435341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ceb07eda-fe8e-4f3b-b594-c1bab3ef2164 tempest-CinderUnicodeTest-83435341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ceb07eda-fe8e-4f3b-b594-c1bab3ef2164 tempest-CinderUnicodeTest-83435341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ceb07eda-fe8e-4f3b-b594-c1bab3ef2164 tempest-CinderUnicodeTest-83435341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:51 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:09:51 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:51 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-905ca6e5-e1d3-48d4-9a97-2e48722050b8 1073741824" returned: 0 in 0.573s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-905ca6e5-e1d3-48d4-9a97-2e48722050b8 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:51 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-905ca6e5-e1d3-48d4-9a97-2e48722050b8 Feb 27 02:09:51 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:51 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ceb07eda-fe8e-4f3b-b594-c1bab3ef2164 tempest-CinderUnicodeTest-83435341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.477s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-ceb07eda-fe8e-4f3b-b594-c1bab3ef2164 tempest-CinderUnicodeTest-83435341 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:51 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-ceb07eda-fe8e-4f3b-b594-c1bab3ef2164 tempest-CinderUnicodeTest-83435341 None] Deleted volume successfully. Feb 27 02:09:51 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ceb07eda-fe8e-4f3b-b594-c1bab3ef2164 tempest-CinderUnicodeTest-83435341 None] Lock "cinder-7947c885-5f9f-4c9e-b6fc-91c51346b814-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:52 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-905ca6e5-e1d3-48d4-9a97-2e48722050b8" returned: 0 in 0.409s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:52 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:09:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9e25c5-82fa-4ba4-b5f1-e9b064cd3a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-905ca6e5-e1d3-48d4-9a97-2e48722050b8', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42ca48d-236e-475a-9303-d9221135e8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:09:52 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Volume volume-905ca6e5-e1d3-48d4-9a97-2e48722050b8 (905ca6e5-e1d3-48d4-9a97-2e48722050b8): created successfully Feb 27 02:09:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42ca48d-236e-475a-9303-d9221135e8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:09:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Flow 'volume_create_manager' (5f73579a-d322-4ef9-ada2-792052c1d158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:09:52 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-7e813249-e26c-41e6-b7c0-1df9768fbf67 tempest-CreateVolumesFromSnapshotTest-228703118 None] Created volume successfully. Feb 27 02:09:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-604f4c1e-b0cb-42bb-830b-7b7717b58d52 tempest-CinderUnicodeTest-83435341 None] Acquiring lock "cinder-6652df86-9c70-4696-b5dc-41651e498491-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-604f4c1e-b0cb-42bb-830b-7b7717b58d52 tempest-CinderUnicodeTest-83435341 None] Lock "cinder-6652df86-9c70-4696-b5dc-41651e498491-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-604f4c1e-b0cb-42bb-830b-7b7717b58d52 tempest-CinderUnicodeTest-83435341 None] Acquiring lock "cinder-quobyte-6652df86-9c70-4696-b5dc-41651e498491" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-604f4c1e-b0cb-42bb-830b-7b7717b58d52 tempest-CinderUnicodeTest-83435341 None] Lock "cinder-quobyte-6652df86-9c70-4696-b5dc-41651e498491" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:52 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f85e95-8cef-436a-b30e-705c2f84b9de]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-604f4c1e-b0cb-42bb-830b-7b7717b58d52 tempest-CinderUnicodeTest-83435341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6652df86-9c70-4696-b5dc-41651e498491 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:52 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6652df86-9c70-4696-b5dc-41651e498491 Feb 27 02:09:52 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b5f1e8a3-e502-4e87-8bef-9e122b974c99 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "cinder-905ca6e5-e1d3-48d4-9a97-2e48722050b8-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b5f1e8a3-e502-4e87-8bef-9e122b974c99 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-905ca6e5-e1d3-48d4-9a97-2e48722050b8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b5f1e8a3-e502-4e87-8bef-9e122b974c99 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "cinder-quobyte-905ca6e5-e1d3-48d4-9a97-2e48722050b8" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b5f1e8a3-e502-4e87-8bef-9e122b974c99 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-quobyte-905ca6e5-e1d3-48d4-9a97-2e48722050b8" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:52 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[932bcb9d-7e32-4611-8b65-476e6c4442cc]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b5f1e8a3-e502-4e87-8bef-9e122b974c99 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-905ca6e5-e1d3-48d4-9a97-2e48722050b8 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:52 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-905ca6e5-e1d3-48d4-9a97-2e48722050b8 Feb 27 02:09:52 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:53 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-604f4c1e-b0cb-42bb-830b-7b7717b58d52 tempest-CinderUnicodeTest-83435341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6652df86-9c70-4696-b5dc-41651e498491" returned: 0 in 0.511s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-604f4c1e-b0cb-42bb-830b-7b7717b58d52 tempest-CinderUnicodeTest-83435341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6652df86-9c70-4696-b5dc-41651e498491 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:53 devstack sudo[89851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6652df86-9c70-4696-b5dc-41651e498491 Feb 27 02:09:53 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:53 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b5f1e8a3-e502-4e87-8bef-9e122b974c99 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-905ca6e5-e1d3-48d4-9a97-2e48722050b8" returned: 0 in 0.475s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b5f1e8a3-e502-4e87-8bef-9e122b974c99 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-905ca6e5-e1d3-48d4-9a97-2e48722050b8 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:53 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-905ca6e5-e1d3-48d4-9a97-2e48722050b8 Feb 27 02:09:53 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:53 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-604f4c1e-b0cb-42bb-830b-7b7717b58d52 tempest-CinderUnicodeTest-83435341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-6652df86-9c70-4696-b5dc-41651e498491" returned: 0 in 0.398s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-604f4c1e-b0cb-42bb-830b-7b7717b58d52 tempest-CinderUnicodeTest-83435341 None] Lock "cinder-quobyte-6652df86-9c70-4696-b5dc-41651e498491" released by "delete_volume" :: held 0.930s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-604f4c1e-b0cb-42bb-830b-7b7717b58d52 tempest-CinderUnicodeTest-83435341 None] Created reservations ['e45290d6-9237-4ddf-ad8e-0194adb1c194', '8a45c859-8a26-4bcb-ad99-ca2e9e864f8f', 'bccf0512-8c1f-445b-8308-d94ff67e6919', '561a9bdb-ad6d-468f-9bce-ae87e1691b59'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-604f4c1e-b0cb-42bb-830b-7b7717b58d52 tempest-CinderUnicodeTest-83435341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-604f4c1e-b0cb-42bb-830b-7b7717b58d52 tempest-CinderUnicodeTest-83435341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-604f4c1e-b0cb-42bb-830b-7b7717b58d52 tempest-CinderUnicodeTest-83435341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-604f4c1e-b0cb-42bb-830b-7b7717b58d52 tempest-CinderUnicodeTest-83435341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-604f4c1e-b0cb-42bb-830b-7b7717b58d52 tempest-CinderUnicodeTest-83435341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-604f4c1e-b0cb-42bb-830b-7b7717b58d52 tempest-CinderUnicodeTest-83435341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:53 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:09:53 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:53 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b5f1e8a3-e502-4e87-8bef-9e122b974c99 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-905ca6e5-e1d3-48d4-9a97-2e48722050b8" returned: 0 in 0.457s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b5f1e8a3-e502-4e87-8bef-9e122b974c99 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-quobyte-905ca6e5-e1d3-48d4-9a97-2e48722050b8" released by "delete_volume" :: held 0.961s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-b5f1e8a3-e502-4e87-8bef-9e122b974c99 tempest-CreateVolumesFromSnapshotTest-228703118 None] Created reservations ['79ee7919-c013-4841-bd52-3c088a04eeb7', '482a2baf-22fa-4739-abf6-1e11befbb36d', '2194ef06-042e-4459-93ce-4ef9a903190a', '9524b7d4-6c5e-419a-addd-252243050d72'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b5f1e8a3-e502-4e87-8bef-9e122b974c99 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b5f1e8a3-e502-4e87-8bef-9e122b974c99 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b5f1e8a3-e502-4e87-8bef-9e122b974c99 tempest-CreateVolumesFromSnapshotTest-228703118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b5f1e8a3-e502-4e87-8bef-9e122b974c99 tempest-CreateVolumesFromSnapshotTest-228703118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b5f1e8a3-e502-4e87-8bef-9e122b974c99 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b5f1e8a3-e502-4e87-8bef-9e122b974c99 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1939cc91-7686-4e92-be1f-e039509a349f tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "cinder-a927cb86-bfa4-4522-bd88-d30e48374937-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:53 devstack sudo[89862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:09:53 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1939cc91-7686-4e92-be1f-e039509a349f tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-a927cb86-bfa4-4522-bd88-d30e48374937-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:54 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1939cc91-7686-4e92-be1f-e039509a349f tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "cinder-quobyte-a927cb86-bfa4-4522-bd88-d30e48374937" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:54 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1939cc91-7686-4e92-be1f-e039509a349f tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-quobyte-a927cb86-bfa4-4522-bd88-d30e48374937" acquired by "delete_volume" :: waited 0.017s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:54 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ad589f-72d6-4959-a8a0-f88b04c47309]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1939cc91-7686-4e92-be1f-e039509a349f tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a927cb86-bfa4-4522-bd88-d30e48374937 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:54 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-604f4c1e-b0cb-42bb-830b-7b7717b58d52 tempest-CinderUnicodeTest-83435341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.585s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:54 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-604f4c1e-b0cb-42bb-830b-7b7717b58d52 tempest-CinderUnicodeTest-83435341 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:54 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a927cb86-bfa4-4522-bd88-d30e48374937 Feb 27 02:09:54 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:54 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-604f4c1e-b0cb-42bb-830b-7b7717b58d52 tempest-CinderUnicodeTest-83435341 None] Deleted volume successfully. Feb 27 02:09:54 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-604f4c1e-b0cb-42bb-830b-7b7717b58d52 tempest-CinderUnicodeTest-83435341 None] Lock "cinder-6652df86-9c70-4696-b5dc-41651e498491-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:54 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b5f1e8a3-e502-4e87-8bef-9e122b974c99 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.567s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:54 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-b5f1e8a3-e502-4e87-8bef-9e122b974c99 tempest-CreateVolumesFromSnapshotTest-228703118 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:54 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-b5f1e8a3-e502-4e87-8bef-9e122b974c99 tempest-CreateVolumesFromSnapshotTest-228703118 None] Deleted volume successfully. Feb 27 02:09:54 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b5f1e8a3-e502-4e87-8bef-9e122b974c99 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-905ca6e5-e1d3-48d4-9a97-2e48722050b8-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:54 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1939cc91-7686-4e92-be1f-e039509a349f tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a927cb86-bfa4-4522-bd88-d30e48374937" returned: 0 in 0.653s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1939cc91-7686-4e92-be1f-e039509a349f tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a927cb86-bfa4-4522-bd88-d30e48374937 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:54 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a927cb86-bfa4-4522-bd88-d30e48374937 Feb 27 02:09:54 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:55 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1939cc91-7686-4e92-be1f-e039509a349f tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a927cb86-bfa4-4522-bd88-d30e48374937" returned: 0 in 0.517s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1939cc91-7686-4e92-be1f-e039509a349f tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-quobyte-a927cb86-bfa4-4522-bd88-d30e48374937" released by "delete_volume" :: held 1.202s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:55 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-1939cc91-7686-4e92-be1f-e039509a349f tempest-CreateVolumesFromSnapshotTest-228703118 None] Created reservations ['5d53442c-53d2-47c6-bc2e-49c3bf26a91f', '5f7ff68b-4b7c-49eb-9488-f17fa0996b1e', '74b41ed9-6451-45ba-8d54-adf0dcc7e60c', '686f7f4c-a07f-4a31-8a79-38617ab62c30'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1939cc91-7686-4e92-be1f-e039509a349f tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1939cc91-7686-4e92-be1f-e039509a349f tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1939cc91-7686-4e92-be1f-e039509a349f tempest-CreateVolumesFromSnapshotTest-228703118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1939cc91-7686-4e92-be1f-e039509a349f tempest-CreateVolumesFromSnapshotTest-228703118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1939cc91-7686-4e92-be1f-e039509a349f tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1939cc91-7686-4e92-be1f-e039509a349f tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:55 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:09:55 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:55 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1939cc91-7686-4e92-be1f-e039509a349f tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.457s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:55 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-1939cc91-7686-4e92-be1f-e039509a349f tempest-CreateVolumesFromSnapshotTest-228703118 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:55 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-1939cc91-7686-4e92-be1f-e039509a349f tempest-CreateVolumesFromSnapshotTest-228703118 None] Deleted volume successfully. Feb 27 02:09:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1939cc91-7686-4e92-be1f-e039509a349f tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-a927cb86-bfa4-4522-bd88-d30e48374937-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4158ceff-8340-46b9-ba7a-8d3e131f1849 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "cinder-7ff8dfbf-1506-4fe4-8cf9-05725d795a16-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4158ceff-8340-46b9-ba7a-8d3e131f1849 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-7ff8dfbf-1506-4fe4-8cf9-05725d795a16-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4158ceff-8340-46b9-ba7a-8d3e131f1849 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "cinder-quobyte-7ff8dfbf-1506-4fe4-8cf9-05725d795a16" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4158ceff-8340-46b9-ba7a-8d3e131f1849 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-quobyte-7ff8dfbf-1506-4fe4-8cf9-05725d795a16" acquired by "delete_volume" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:56 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3739aa-8d24-4d42-8735-b72013c846ac]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4158ceff-8340-46b9-ba7a-8d3e131f1849 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7ff8dfbf-1506-4fe4-8cf9-05725d795a16 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:56 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7ff8dfbf-1506-4fe4-8cf9-05725d795a16 Feb 27 02:09:56 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:56 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4158ceff-8340-46b9-ba7a-8d3e131f1849 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7ff8dfbf-1506-4fe4-8cf9-05725d795a16" returned: 0 in 0.510s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4158ceff-8340-46b9-ba7a-8d3e131f1849 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7ff8dfbf-1506-4fe4-8cf9-05725d795a16 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:56 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7ff8dfbf-1506-4fe4-8cf9-05725d795a16 Feb 27 02:09:56 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:57 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4158ceff-8340-46b9-ba7a-8d3e131f1849 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-7ff8dfbf-1506-4fe4-8cf9-05725d795a16" returned: 0 in 0.423s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4158ceff-8340-46b9-ba7a-8d3e131f1849 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-quobyte-7ff8dfbf-1506-4fe4-8cf9-05725d795a16" released by "delete_volume" :: held 0.960s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:57 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-4158ceff-8340-46b9-ba7a-8d3e131f1849 tempest-CreateVolumesFromSnapshotTest-228703118 None] Created reservations ['2c291b07-e57f-484c-8acb-17b19b250135', '096c9205-51d2-4fb4-80a8-a45a158f2cea', '55f702e3-24b2-4b48-8d7b-93833a9d6583', 'f9439412-a907-4ec8-bfd2-f560be98c84c'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4158ceff-8340-46b9-ba7a-8d3e131f1849 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4158ceff-8340-46b9-ba7a-8d3e131f1849 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4158ceff-8340-46b9-ba7a-8d3e131f1849 tempest-CreateVolumesFromSnapshotTest-228703118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4158ceff-8340-46b9-ba7a-8d3e131f1849 tempest-CreateVolumesFromSnapshotTest-228703118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4158ceff-8340-46b9-ba7a-8d3e131f1849 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4158ceff-8340-46b9-ba7a-8d3e131f1849 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:57 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:09:57 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5d667497-98e7-47a3-a040-aac8c01ec158 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "cinder-e5ed4118-3ddc-4248-a438-8a9d26361d0e-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5d667497-98e7-47a3-a040-aac8c01ec158 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-e5ed4118-3ddc-4248-a438-8a9d26361d0e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5d667497-98e7-47a3-a040-aac8c01ec158 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "cinder-quobyte-e5ed4118-3ddc-4248-a438-8a9d26361d0e" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5d667497-98e7-47a3-a040-aac8c01ec158 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-quobyte-e5ed4118-3ddc-4248-a438-8a9d26361d0e" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:57 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4d36cb-20d2-4185-9adc-e093df65a799]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5d667497-98e7-47a3-a040-aac8c01ec158 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e5ed4118-3ddc-4248-a438-8a9d26361d0e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:57 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e5ed4118-3ddc-4248-a438-8a9d26361d0e Feb 27 02:09:57 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:57 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4158ceff-8340-46b9-ba7a-8d3e131f1849 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.461s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:57 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-4158ceff-8340-46b9-ba7a-8d3e131f1849 tempest-CreateVolumesFromSnapshotTest-228703118 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:57 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-4158ceff-8340-46b9-ba7a-8d3e131f1849 tempest-CreateVolumesFromSnapshotTest-228703118 None] Deleted volume successfully. Feb 27 02:09:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4158ceff-8340-46b9-ba7a-8d3e131f1849 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-7ff8dfbf-1506-4fe4-8cf9-05725d795a16-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:57 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5d667497-98e7-47a3-a040-aac8c01ec158 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e5ed4118-3ddc-4248-a438-8a9d26361d0e" returned: 0 in 0.540s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5d667497-98e7-47a3-a040-aac8c01ec158 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e5ed4118-3ddc-4248-a438-8a9d26361d0e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:58 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e5ed4118-3ddc-4248-a438-8a9d26361d0e Feb 27 02:09:58 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:58 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5d667497-98e7-47a3-a040-aac8c01ec158 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e5ed4118-3ddc-4248-a438-8a9d26361d0e" returned: 0 in 0.409s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:58 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5d667497-98e7-47a3-a040-aac8c01ec158 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-quobyte-e5ed4118-3ddc-4248-a438-8a9d26361d0e" released by "delete_volume" :: held 0.971s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:58 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-5d667497-98e7-47a3-a040-aac8c01ec158 tempest-CreateVolumesFromSnapshotTest-228703118 None] Created reservations ['4056052c-7ecc-4316-9e00-a11f92a5523e', '187734a7-1157-4308-a4f6-580271aa8966', 'fb78b636-8f9c-40ea-bef8-9c7039b66e18', '67dc925c-1ff2-4d69-a397-84a4571c3ff0'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:09:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5d667497-98e7-47a3-a040-aac8c01ec158 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:09:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5d667497-98e7-47a3-a040-aac8c01ec158 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:09:58 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5d667497-98e7-47a3-a040-aac8c01ec158 tempest-CreateVolumesFromSnapshotTest-228703118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:09:58 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5d667497-98e7-47a3-a040-aac8c01ec158 tempest-CreateVolumesFromSnapshotTest-228703118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:09:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5d667497-98e7-47a3-a040-aac8c01ec158 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:09:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5d667497-98e7-47a3-a040-aac8c01ec158 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:58 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:09:58 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:09:58 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Feb 27 02:09:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5d667497-98e7-47a3-a040-aac8c01ec158 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.406s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:09:58 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-5d667497-98e7-47a3-a040-aac8c01ec158 tempest-CreateVolumesFromSnapshotTest-228703118 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:09:58 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-5d667497-98e7-47a3-a040-aac8c01ec158 tempest-CreateVolumesFromSnapshotTest-228703118 None] Deleted volume successfully. Feb 27 02:09:58 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5d667497-98e7-47a3-a040-aac8c01ec158 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-e5ed4118-3ddc-4248-a438-8a9d26361d0e-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:09:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bb497be3-df5d-4fc8-89b9-06cbc3306377 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "cinder-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bb497be3-df5d-4fc8-89b9-06cbc3306377 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bb497be3-df5d-4fc8-89b9-06cbc3306377 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "cinder-quobyte-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:09:59 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bb497be3-df5d-4fc8-89b9-06cbc3306377 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-quobyte-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:09:59 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3325e08f-c411-45fc-9c6c-ac0d4e78a34d]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:09:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bb497be3-df5d-4fc8-89b9-06cbc3306377 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:09:59 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f Feb 27 02:09:59 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:00 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bb497be3-df5d-4fc8-89b9-06cbc3306377 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f" returned: 0 in 0.475s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bb497be3-df5d-4fc8-89b9-06cbc3306377 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:00 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f Feb 27 02:10:00 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:00 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bb497be3-df5d-4fc8-89b9-06cbc3306377 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f" returned: 0 in 0.428s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:00 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bb497be3-df5d-4fc8-89b9-06cbc3306377 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-quobyte-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f" released by "delete_volume" :: held 0.926s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:00 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-bb497be3-df5d-4fc8-89b9-06cbc3306377 tempest-CreateVolumesFromSnapshotTest-228703118 None] Created reservations ['93ecd853-f675-4362-a550-c382b8283ad0', '06ea8070-9e04-4dbc-b57c-742d52b99bc9', 'acdce974-dabe-4dd3-b832-c123511400e4', '76a6abe4-b05a-4536-a63f-fd96555017dc'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bb497be3-df5d-4fc8-89b9-06cbc3306377 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bb497be3-df5d-4fc8-89b9-06cbc3306377 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-bb497be3-df5d-4fc8-89b9-06cbc3306377 tempest-CreateVolumesFromSnapshotTest-228703118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-bb497be3-df5d-4fc8-89b9-06cbc3306377 tempest-CreateVolumesFromSnapshotTest-228703118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-bb497be3-df5d-4fc8-89b9-06cbc3306377 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bb497be3-df5d-4fc8-89b9-06cbc3306377 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:00 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:10:00 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:00 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "cinder-c729f600-82a3-4b79-a5f4-86bfd727cd70-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:00 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-c729f600-82a3-4b79-a5f4-86bfd727cd70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:00 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "cinder-quobyte-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:00 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-quobyte-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:00 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "cinder-quobyte-c729f600-82a3-4b79-a5f4-86bfd727cd70" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:00 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-quobyte-c729f600-82a3-4b79-a5f4-86bfd727cd70" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] Deleting offline snapshot c729f600-82a3-4b79-a5f4-86bfd727cd70 of volume 9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:10:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] snapshot_file for this snap is: volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.c729f600-82a3-4b79-a5f4-86bfd727cd70 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:10:00 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3435df-8ed1-48aa-a181-f5eb59e18853]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.c729f600-82a3-4b79-a5f4-86bfd727cd70 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:00 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.c729f600-82a3-4b79-a5f4-86bfd727cd70 Feb 27 02:10:00 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:01 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-bb497be3-df5d-4fc8-89b9-06cbc3306377 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.445s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:01 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-bb497be3-df5d-4fc8-89b9-06cbc3306377 tempest-CreateVolumesFromSnapshotTest-228703118 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:01 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-bb497be3-df5d-4fc8-89b9-06cbc3306377 tempest-CreateVolumesFromSnapshotTest-228703118 None] Deleted volume successfully. Feb 27 02:10:01 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-bb497be3-df5d-4fc8-89b9-06cbc3306377 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-b6e5f8bb-17a4-47b2-acfc-38e49f72bf0f-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:01 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.c729f600-82a3-4b79-a5f4-86bfd727cd70" returned: 0 in 0.493s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:10:01 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bd0e2b-85eb-46e0-b6a7-904f55acade6]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:01 devstack sudo[89916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d Feb 27 02:10:01 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:01 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d" returned: 0 in 0.452s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.c729f600-82a3-4b79-a5f4-86bfd727cd70 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:01 devstack sudo[89921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.c729f600-82a3-4b79-a5f4-86bfd727cd70 Feb 27 02:10:01 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:02 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.c729f600-82a3-4b79-a5f4-86bfd727cd70" returned: 0 in 0.440s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.c729f600-82a3-4b79-a5f4-86bfd727cd70 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:02 devstack sudo[89926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.c729f600-82a3-4b79-a5f4-86bfd727cd70 Feb 27 02:10:02 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:02 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d.c729f600-82a3-4b79-a5f4-86bfd727cd70" returned: 0 in 0.420s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:02 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-quobyte-c729f600-82a3-4b79-a5f4-86bfd727cd70" released by "_delete_snapshot" :: held 1.874s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:02 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-quobyte-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d" released by "delete_snapshot" :: held 1.893s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:02 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] Created reservations ['cc2b980b-0278-428b-a515-1ec24ecadfad', 'aaf8b6c9-4488-4a17-b42f-dc110889a147', '98fe6310-6b24-407a-b7aa-031889ab34d8', '0cd311b1-504b-4ffa-a169-51b902366bba'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:02 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] Delete snapshot completed successfully. Feb 27 02:10:02 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4e71597b-d0c2-4752-8c6b-d7c82d7d6c33 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-c729f600-82a3-4b79-a5f4-86bfd727cd70-delete_snapshot" released by "delete_snapshot" :: held 2.002s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:02 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e9608f4d-9b8a-4301-9034-8b8192f04926 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "cinder-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:02 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e9608f4d-9b8a-4301-9034-8b8192f04926 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:02 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e9608f4d-9b8a-4301-9034-8b8192f04926 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "cinder-quobyte-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:02 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e9608f4d-9b8a-4301-9034-8b8192f04926 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-quobyte-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:02 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4c428c-1fa9-46ad-9d28-f411d9e323a2]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e9608f4d-9b8a-4301-9034-8b8192f04926 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:02 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d Feb 27 02:10:02 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:03 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e9608f4d-9b8a-4301-9034-8b8192f04926 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d" returned: 0 in 0.482s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e9608f4d-9b8a-4301-9034-8b8192f04926 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:03 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d Feb 27 02:10:03 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:03 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e9608f4d-9b8a-4301-9034-8b8192f04926 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d" returned: 0 in 0.402s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:03 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e9608f4d-9b8a-4301-9034-8b8192f04926 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-quobyte-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d" released by "delete_volume" :: held 0.917s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:03 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-e9608f4d-9b8a-4301-9034-8b8192f04926 tempest-CreateVolumesFromSnapshotTest-228703118 None] Created reservations ['904e2001-fcb2-4055-a696-5d1f669d85c9', '651b5529-9cf1-4df0-ad71-ba90dce7e676', 'fb5b966c-1cd6-44d2-9f1b-62e4d5e509bb', '42859172-2486-49c6-ab8e-c251f4d31f50'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e9608f4d-9b8a-4301-9034-8b8192f04926 tempest-CreateVolumesFromSnapshotTest-228703118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e9608f4d-9b8a-4301-9034-8b8192f04926 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e9608f4d-9b8a-4301-9034-8b8192f04926 tempest-CreateVolumesFromSnapshotTest-228703118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e9608f4d-9b8a-4301-9034-8b8192f04926 tempest-CreateVolumesFromSnapshotTest-228703118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e9608f4d-9b8a-4301-9034-8b8192f04926 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e9608f4d-9b8a-4301-9034-8b8192f04926 tempest-CreateVolumesFromSnapshotTest-228703118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:03 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:10:03 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:04 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e9608f4d-9b8a-4301-9034-8b8192f04926 tempest-CreateVolumesFromSnapshotTest-228703118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.477s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:04 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-e9608f4d-9b8a-4301-9034-8b8192f04926 tempest-CreateVolumesFromSnapshotTest-228703118 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:04 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-e9608f4d-9b8a-4301-9034-8b8192f04926 tempest-CreateVolumesFromSnapshotTest-228703118 None] Deleted volume successfully. Feb 27 02:10:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e9608f4d-9b8a-4301-9034-8b8192f04926 tempest-CreateVolumesFromSnapshotTest-228703118 None] Lock "cinder-9e1a67c1-dc65-47c0-b1e9-bd2d0c33469d-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:09 devstack cinder-volume[82683]: DEBUG oslo_service.periodic_task [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:10:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:09 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:10:09 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:09 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.538s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:09 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:13 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:UPDATE=203,cinder:SELECT=141,cinder:INSERT=50,cinder:DELETE=15 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:10:14 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:SELECT=138,cinder:UPDATE=199,cinder:INSERT=48,cinder:DELETE=19 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Flow 'volume_create_manager' (d227b476-a789-4ac4-82bb-77b537cb3d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6aafa43-6e4d-401f-9205-bdc8e42bd66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6aafa43-6e4d-401f-9205-bdc8e42bd66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-670270749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f5b3c1-4bf2-405b-af4f-6e225c37caf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c58c86ca1baf4b7ebdbfb5f47303724f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:22Z,use_quota=True,user_id='93cc9b3f865646d1879951697a6d2757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de581872-d461-4efa-a86b-4769eac6dd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de581872-d461-4efa-a86b-4769eac6dd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50612536-610f-4941-8b7e-70e3126df1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50612536-610f-4941-8b7e-70e3126df1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22f5b3c1-4bf2-405b-af4f-6e225c37caf4', 'volume_name': 'volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d715937a-7c8f-4a86-9778-a721e3a6c656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d715937a-7c8f-4a86-9778-a721e3a6c656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2577dbd7-d44d-4dbf-bce0-69689cd8f872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:21 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Volume 22f5b3c1-4bf2-405b-af4f-6e225c37caf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4', 'volume_size': 1} Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-670270749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f5b3c1-4bf2-405b-af4f-6e225c37caf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c58c86ca1baf4b7ebdbfb5f47303724f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:22Z,use_quota=True,user_id='93cc9b3f865646d1879951697a6d2757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Creating volume 22f5b3c1-4bf2-405b-af4f-6e225c37caf4 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:21 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:10:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:21 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 1073741824 Feb 27 02:10:21 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:22 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 1073741824" returned: 0 in 0.527s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:22 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 Feb 27 02:10:22 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:22 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4" returned: 0 in 0.502s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2577dbd7-d44d-4dbf-bce0-69689cd8f872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548370f7-7a2a-4378-af58-db5fa5825634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:22 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Volume volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 (22f5b3c1-4bf2-405b-af4f-6e225c37caf4): created successfully Feb 27 02:10:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548370f7-7a2a-4378-af58-db5fa5825634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Flow 'volume_create_manager' (d227b476-a789-4ac4-82bb-77b537cb3d99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:23 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-f0d1adbc-214f-4473-9c29-a088c383e19d tempest-SnapshotDependencyTests-2057581579 None] Created volume successfully. Feb 27 02:10:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-383001d7-50d6-4fa8-97f6-dce45641d70c tempest-SnapshotDependencyTests-2057581579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-383001d7-50d6-4fa8-97f6-dce45641d70c tempest-SnapshotDependencyTests-2057581579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:24 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-383001d7-50d6-4fa8-97f6-dce45641d70c tempest-SnapshotDependencyTests-2057581579 None] Creating offline snapshot e86f2a26-84b0-4523-94e4-cef7632822d2 of volume 22f5b3c1-4bf2-405b-af4f-6e225c37caf4 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:10:24 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7a8617-16b8-4d96-b9fc-318d4ba6bc1a]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-383001d7-50d6-4fa8-97f6-dce45641d70c tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:24 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 Feb 27 02:10:24 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:24 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-383001d7-50d6-4fa8-97f6-dce45641d70c tempest-SnapshotDependencyTests-2057581579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4" returned: 0 in 0.493s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-383001d7-50d6-4fa8-97f6-dce45641d70c tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:24 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2 1G Feb 27 02:10:24 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:25 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-383001d7-50d6-4fa8-97f6-dce45641d70c tempest-SnapshotDependencyTests-2057581579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2 1G" returned: 0 in 0.518s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-383001d7-50d6-4fa8-97f6-dce45641d70c tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:25 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2 Feb 27 02:10:25 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:25 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-383001d7-50d6-4fa8-97f6-dce45641d70c tempest-SnapshotDependencyTests-2057581579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2" returned: 0 in 0.460s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:25 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-383001d7-50d6-4fa8-97f6-dce45641d70c tempest-SnapshotDependencyTests-2057581579 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2 is being set with open permissions: ugo+rw Feb 27 02:10:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-383001d7-50d6-4fa8-97f6-dce45641d70c tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:25 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2 Feb 27 02:10:25 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:26 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-383001d7-50d6-4fa8-97f6-dce45641d70c tempest-SnapshotDependencyTests-2057581579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2" returned: 0 in 0.434s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-383001d7-50d6-4fa8-97f6-dce45641d70c tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:26 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.info Feb 27 02:10:26 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:26 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-383001d7-50d6-4fa8-97f6-dce45641d70c tempest-SnapshotDependencyTests-2057581579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.info" returned: 0 in 0.436s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:26 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-383001d7-50d6-4fa8-97f6-dce45641d70c tempest-SnapshotDependencyTests-2057581579 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.info is being set with open permissions: ugo+rw Feb 27 02:10:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-383001d7-50d6-4fa8-97f6-dce45641d70c tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:26 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.info Feb 27 02:10:26 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:26 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-383001d7-50d6-4fa8-97f6-dce45641d70c tempest-SnapshotDependencyTests-2057581579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.info" returned: 0 in 0.457s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-383001d7-50d6-4fa8-97f6-dce45641d70c tempest-SnapshotDependencyTests-2057581579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.856s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:27 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-383001d7-50d6-4fa8-97f6-dce45641d70c tempest-SnapshotDependencyTests-2057581579 None] Create snapshot completed successfully Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Flow 'volume_create_manager' (6d5d38d5-f46b-479b-b281-f676da170d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (714410d1-9e91-4914-bf96-755eb805ad32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (714410d1-9e91-4914-bf96-755eb805ad32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62de6e39-7f01-4bf9-b837-e72df5853538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c58c86ca1baf4b7ebdbfb5f47303724f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e86f2a26-84b0-4523-94e4-cef7632822d2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:28Z,use_quota=True,user_id='93cc9b3f865646d1879951697a6d2757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691bbd96-37bf-437b-925b-3edb59c7ab15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691bbd96-37bf-437b-925b-3edb59c7ab15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a23f59-2bd4-4ff7-8f01-974dc4d81a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a23f59-2bd4-4ff7-8f01-974dc4d81a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '62de6e39-7f01-4bf9-b837-e72df5853538', 'volume_name': 'volume-62de6e39-7f01-4bf9-b837-e72df5853538', 'volume_size': 1, 'snapshot_id': 'e86f2a26-84b0-4523-94e4-cef7632822d2'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92704313-2a89-4591-a1bd-d7b3be256045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92704313-2a89-4591-a1bd-d7b3be256045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54028a2a-b231-4dcf-9676-cdb47b478cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:27 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Volume 62de6e39-7f01-4bf9-b837-e72df5853538: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-62de6e39-7f01-4bf9-b837-e72df5853538', 'volume_size': 1, 'snapshot_id': 'e86f2a26-84b0-4523-94e4-cef7632822d2'} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Acquiring lock "cinder-quobyte-e86f2a26-84b0-4523-94e4-cef7632822d2-62de6e39-7f01-4bf9-b837-e72df5853538" by "_create_volume_from_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Lock "cinder-quobyte-e86f2a26-84b0-4523-94e4-cef7632822d2-62de6e39-7f01-4bf9-b837-e72df5853538" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Creating volume 62de6e39-7f01-4bf9-b837-e72df5853538 from snapshot e86f2a26-84b0-4523-94e4-cef7632822d2 {{(pid=82683) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Acquiring lock "cinder-quobyte-62de6e39-7f01-4bf9-b837-e72df5853538" by "_copy_volume_from_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Lock "cinder-quobyte-62de6e39-7f01-4bf9-b837-e72df5853538" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] snapshot: e86f2a26-84b0-4523-94e4-cef7632822d2, volume: 62de6e39-7f01-4bf9-b837-e72df5853538, {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed159aa9-c273-44da-9341-61312628f9a4]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:27 devstack sudo[90021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2 Feb 27 02:10:27 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:28 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2" returned: 0 in 0.509s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:28 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:10:28 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] will copy from snapshot at /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:10:28 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Creating direct copy from snapshot {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:10:28 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[82608b74-34ed-4a84-a586-007d9a5a2dc6]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:28 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 Feb 27 02:10:28 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:28 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4" returned: 0 in 0.561s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:28 devstack cinder-volume[82683]: DEBUG cinder.utils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Path /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-62de6e39-7f01-4bf9-b837-e72df5853538 not found in is_blk_device check {{(pid=82683) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:10:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-62de6e39-7f01-4bf9-b837-e72df5853538 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:28 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-62de6e39-7f01-4bf9-b837-e72df5853538 Feb 27 02:10:28 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:31 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-62de6e39-7f01-4bf9-b837-e72df5853538" returned: 0 in 2.348s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:31 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf8ba7d-efd4-4478-8842-7a7c1e2896a0]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:31 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 Feb 27 02:10:31 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:31 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4" returned: 0 in 0.667s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:31 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Image conversion details: src /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4, size 1024.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-62de6e39-7f01-4bf9-b837-e72df5853538 {{(pid=82683) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:10:31 devstack cinder-volume[82683]: INFO cinder.image.image_utils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Converted 1024.00 MB image at 435.72 MB/s Feb 27 02:10:31 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-62de6e39-7f01-4bf9-b837-e72df5853538 is being set with open permissions: ugo+rw Feb 27 02:10:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-62de6e39-7f01-4bf9-b837-e72df5853538 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:31 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-62de6e39-7f01-4bf9-b837-e72df5853538 Feb 27 02:10:31 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:32 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-62de6e39-7f01-4bf9-b837-e72df5853538" returned: 0 in 0.445s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:32 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Lock "cinder-quobyte-62de6e39-7f01-4bf9-b837-e72df5853538" released by "_copy_volume_from_snapshot" :: held 4.597s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:32 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Lock "cinder-quobyte-e86f2a26-84b0-4523-94e4-cef7632822d2-62de6e39-7f01-4bf9-b837-e72df5853538" released by "_create_volume_from_snapshot" :: held 4.616s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.626s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54028a2a-b231-4dcf-9676-cdb47b478cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62de6e39-7f01-4bf9-b837-e72df5853538', 'volume_size': 1, 'snapshot_id': 'e86f2a26-84b0-4523-94e4-cef7632822d2'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13370db0-343f-4d5c-85cf-54fd565f5da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:32 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Volume volume-62de6e39-7f01-4bf9-b837-e72df5853538 (62de6e39-7f01-4bf9-b837-e72df5853538): created successfully Feb 27 02:10:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13370db0-343f-4d5c-85cf-54fd565f5da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Flow 'volume_create_manager' (6d5d38d5-f46b-479b-b281-f676da170d74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:32 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-e7f9a7bb-e8d4-489d-9168-4c42896157ac tempest-SnapshotDependencyTests-2057581579 None] Created volume successfully. Feb 27 02:10:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] Acquiring lock "cinder-e86f2a26-84b0-4523-94e4-cef7632822d2-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] Lock "cinder-e86f2a26-84b0-4523-94e4-cef7632822d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] Acquiring lock "cinder-quobyte-22f5b3c1-4bf2-405b-af4f-6e225c37caf4" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] Lock "cinder-quobyte-22f5b3c1-4bf2-405b-af4f-6e225c37caf4" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] Acquiring lock "cinder-quobyte-e86f2a26-84b0-4523-94e4-cef7632822d2" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:33 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] Lock "cinder-quobyte-e86f2a26-84b0-4523-94e4-cef7632822d2" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:33 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] Deleting offline snapshot e86f2a26-84b0-4523-94e4-cef7632822d2 of volume 22f5b3c1-4bf2-405b-af4f-6e225c37caf4 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:10:33 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] snapshot_file for this snap is: volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:10:33 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0ed5f1-c461-4988-adc7-92568940e073]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:33 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2 Feb 27 02:10:33 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:33 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2" returned: 0 in 0.505s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:33 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:10:33 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4a2c66-0e09-4031-b147-689e98b1b744]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:33 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 Feb 27 02:10:33 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:34 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4" returned: 0 in 0.526s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:34 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2 Feb 27 02:10:34 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:34 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2" returned: 0 in 0.544s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:34 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2 Feb 27 02:10:34 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:35 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4.e86f2a26-84b0-4523-94e4-cef7632822d2" returned: 0 in 0.409s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:35 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] Lock "cinder-quobyte-e86f2a26-84b0-4523-94e4-cef7632822d2" released by "_delete_snapshot" :: held 2.044s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:35 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] Lock "cinder-quobyte-22f5b3c1-4bf2-405b-af4f-6e225c37caf4" released by "delete_snapshot" :: held 2.056s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:35 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] Created reservations ['229a70cf-386c-41bf-906e-aa728ab12950', 'bb118c92-2620-4e7c-8d76-cddde9513a0b', '66334612-7fc0-460a-b4b8-9fc5e59f7082', 'c158bf1e-db18-4927-9972-4c410cf08c57'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:35 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] Delete snapshot completed successfully. Feb 27 02:10:35 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e8d2543a-cd19-4f9c-bc59-db03bd2cd65f tempest-SnapshotDependencyTests-2057581579 None] Lock "cinder-e86f2a26-84b0-4523-94e4-cef7632822d2-delete_snapshot" released by "delete_snapshot" :: held 2.667s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-65b9c29c-6909-4fdd-9bd6-8703addeb8d9 tempest-SnapshotDependencyTests-2057581579 None] Acquiring lock "cinder-22f5b3c1-4bf2-405b-af4f-6e225c37caf4-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-65b9c29c-6909-4fdd-9bd6-8703addeb8d9 tempest-SnapshotDependencyTests-2057581579 None] Lock "cinder-22f5b3c1-4bf2-405b-af4f-6e225c37caf4-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:39 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-65b9c29c-6909-4fdd-9bd6-8703addeb8d9 tempest-SnapshotDependencyTests-2057581579 None] Acquiring lock "cinder-quobyte-22f5b3c1-4bf2-405b-af4f-6e225c37caf4" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:39 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-65b9c29c-6909-4fdd-9bd6-8703addeb8d9 tempest-SnapshotDependencyTests-2057581579 None] Lock "cinder-quobyte-22f5b3c1-4bf2-405b-af4f-6e225c37caf4" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:39 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0429c4-c968-47ce-83e8-e6e3110aadfd]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-65b9c29c-6909-4fdd-9bd6-8703addeb8d9 tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:39 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 Feb 27 02:10:39 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:40 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-65b9c29c-6909-4fdd-9bd6-8703addeb8d9 tempest-SnapshotDependencyTests-2057581579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4" returned: 0 in 0.508s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-65b9c29c-6909-4fdd-9bd6-8703addeb8d9 tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:40 devstack sudo[90077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4 Feb 27 02:10:40 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:40 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-65b9c29c-6909-4fdd-9bd6-8703addeb8d9 tempest-SnapshotDependencyTests-2057581579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-22f5b3c1-4bf2-405b-af4f-6e225c37caf4" returned: 0 in 0.443s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:40 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-65b9c29c-6909-4fdd-9bd6-8703addeb8d9 tempest-SnapshotDependencyTests-2057581579 None] Lock "cinder-quobyte-22f5b3c1-4bf2-405b-af4f-6e225c37caf4" released by "delete_volume" :: held 0.996s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:40 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-65b9c29c-6909-4fdd-9bd6-8703addeb8d9 tempest-SnapshotDependencyTests-2057581579 None] Created reservations ['77448de9-2d8b-4128-ac22-fbbd243f3ca2', '39e4b7b9-3ca7-4d8d-8f00-e46115dfef08', '9a96b9e2-60f6-43bd-bcf3-bce6f5824c76', '3b7ae6d0-a26d-4fd9-b5de-734189376d61'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-65b9c29c-6909-4fdd-9bd6-8703addeb8d9 tempest-SnapshotDependencyTests-2057581579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-65b9c29c-6909-4fdd-9bd6-8703addeb8d9 tempest-SnapshotDependencyTests-2057581579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:40 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-65b9c29c-6909-4fdd-9bd6-8703addeb8d9 tempest-SnapshotDependencyTests-2057581579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:40 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-65b9c29c-6909-4fdd-9bd6-8703addeb8d9 tempest-SnapshotDependencyTests-2057581579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-65b9c29c-6909-4fdd-9bd6-8703addeb8d9 tempest-SnapshotDependencyTests-2057581579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-65b9c29c-6909-4fdd-9bd6-8703addeb8d9 tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:40 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:10:40 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-c817cf82-d5de-4d23-b287-577bb2729d55 tempest-SnapshotDependencyTests-2057581579 None] Acquiring lock "cinder-62de6e39-7f01-4bf9-b837-e72df5853538-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-c817cf82-d5de-4d23-b287-577bb2729d55 tempest-SnapshotDependencyTests-2057581579 None] Lock "cinder-62de6e39-7f01-4bf9-b837-e72df5853538-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-c817cf82-d5de-4d23-b287-577bb2729d55 tempest-SnapshotDependencyTests-2057581579 None] Acquiring lock "cinder-quobyte-62de6e39-7f01-4bf9-b837-e72df5853538" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:10:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-c817cf82-d5de-4d23-b287-577bb2729d55 tempest-SnapshotDependencyTests-2057581579 None] Lock "cinder-quobyte-62de6e39-7f01-4bf9-b837-e72df5853538" acquired by "delete_volume" :: waited 0.008s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:10:41 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-65b9c29c-6909-4fdd-9bd6-8703addeb8d9 tempest-SnapshotDependencyTests-2057581579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.454s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:41 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-65b9c29c-6909-4fdd-9bd6-8703addeb8d9 tempest-SnapshotDependencyTests-2057581579 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:41 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafc4d3a-5bd4-4097-ba2f-d86abff0f615]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:10:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c817cf82-d5de-4d23-b287-577bb2729d55 tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-62de6e39-7f01-4bf9-b837-e72df5853538 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:41 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-65b9c29c-6909-4fdd-9bd6-8703addeb8d9 tempest-SnapshotDependencyTests-2057581579 None] Deleted volume successfully. Feb 27 02:10:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-65b9c29c-6909-4fdd-9bd6-8703addeb8d9 tempest-SnapshotDependencyTests-2057581579 None] Lock "cinder-22f5b3c1-4bf2-405b-af4f-6e225c37caf4-delete_volume" released by "delete_volume" :: held 3.332s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:41 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-62de6e39-7f01-4bf9-b837-e72df5853538 Feb 27 02:10:41 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:41 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c817cf82-d5de-4d23-b287-577bb2729d55 tempest-SnapshotDependencyTests-2057581579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-62de6e39-7f01-4bf9-b837-e72df5853538" returned: 0 in 0.523s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c817cf82-d5de-4d23-b287-577bb2729d55 tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-62de6e39-7f01-4bf9-b837-e72df5853538 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:41 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-62de6e39-7f01-4bf9-b837-e72df5853538 Feb 27 02:10:41 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:42 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c817cf82-d5de-4d23-b287-577bb2729d55 tempest-SnapshotDependencyTests-2057581579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-62de6e39-7f01-4bf9-b837-e72df5853538" returned: 0 in 0.445s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:42 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-c817cf82-d5de-4d23-b287-577bb2729d55 tempest-SnapshotDependencyTests-2057581579 None] Lock "cinder-quobyte-62de6e39-7f01-4bf9-b837-e72df5853538" released by "delete_volume" :: held 1.004s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:42 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-c817cf82-d5de-4d23-b287-577bb2729d55 tempest-SnapshotDependencyTests-2057581579 None] Created reservations ['3fcbc72a-12c0-480e-8223-7686b251388d', '65ed3c58-125c-4d3a-a86b-d192fcdbccc9', '2d2c0073-b4b0-48dd-b7c3-13800d5b836c', '99b0bac1-0ef9-4fef-b875-b9e687d74e20'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:10:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c817cf82-d5de-4d23-b287-577bb2729d55 tempest-SnapshotDependencyTests-2057581579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c817cf82-d5de-4d23-b287-577bb2729d55 tempest-SnapshotDependencyTests-2057581579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:42 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-c817cf82-d5de-4d23-b287-577bb2729d55 tempest-SnapshotDependencyTests-2057581579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:42 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-c817cf82-d5de-4d23-b287-577bb2729d55 tempest-SnapshotDependencyTests-2057581579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c817cf82-d5de-4d23-b287-577bb2729d55 tempest-SnapshotDependencyTests-2057581579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c817cf82-d5de-4d23-b287-577bb2729d55 tempest-SnapshotDependencyTests-2057581579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:42 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:10:42 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:42 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c817cf82-d5de-4d23-b287-577bb2729d55 tempest-SnapshotDependencyTests-2057581579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.461s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:42 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-c817cf82-d5de-4d23-b287-577bb2729d55 tempest-SnapshotDependencyTests-2057581579 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:10:42 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-c817cf82-d5de-4d23-b287-577bb2729d55 tempest-SnapshotDependencyTests-2057581579 None] Deleted volume successfully. Feb 27 02:10:42 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-c817cf82-d5de-4d23-b287-577bb2729d55 tempest-SnapshotDependencyTests-2057581579 None] Lock "cinder-62de6e39-7f01-4bf9-b837-e72df5853538-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:10:52 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:SELECT=27,cinder:UPDATE=31,cinder:INSERT=9,cinder:DELETE=2 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:10:52 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:UPDATE=26,cinder:SELECT=21,cinder:DELETE=3,cinder:INSERT=5 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:10:57 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Flow 'volume_create_manager' (1e4d7510-9763-4282-9fe5-2cd16f8980ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ef11ac-0c7d-46aa-9490-cd19b345e57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ef11ac-0c7d-46aa-9490-cd19b345e57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-116032791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c109c5-c68e-4c84-88a7-6a742ff1850b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3737eb87ffae44c482b59cb3242336aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:58Z,use_quota=True,user_id='1ff8d624acd04a748397803df87d2520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f005ae1-4cac-485b-854c-07757c311193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f005ae1-4cac-485b-854c-07757c311193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97f2d3e-7e3a-4a25-8d7d-4df5b33fc40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97f2d3e-7e3a-4a25-8d7d-4df5b33fc40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78c109c5-c68e-4c84-88a7-6a742ff1850b', 'volume_name': 'volume-78c109c5-c68e-4c84-88a7-6a742ff1850b', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5e4161-a381-461d-a50b-3a84b5d44aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5e4161-a381-461d-a50b-3a84b5d44aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e5c076-3e09-431a-8c19-abffa6a5ff1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Volume 78c109c5-c68e-4c84-88a7-6a742ff1850b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78c109c5-c68e-4c84-88a7-6a742ff1850b', 'volume_size': 1} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-116032791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c109c5-c68e-4c84-88a7-6a742ff1850b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3737eb87ffae44c482b59cb3242336aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:58Z,use_quota=True,user_id='1ff8d624acd04a748397803df87d2520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Creating volume 78c109c5-c68e-4c84-88a7-6a742ff1850b {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:58 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:58 devstack sudo[90139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b 1073741824 Feb 27 02:10:58 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Flow 'volume_create_manager' (ac8f8287-9494-438f-b9b7-6edbb589776a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f6fdc79-46d8-46d3-a152-97fbc0f07109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f6fdc79-46d8-46d3-a152-97fbc0f07109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-744397289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd2d63fa-c32a-4322-af82-182a2235b044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45396a1c0a674ff480fe92d2c1352bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:58Z,use_quota=True,user_id='8c875b868f794e6f984c658f47126c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f53baf-fe69-4181-87a6-9387d7cd791a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f53baf-fe69-4181-87a6-9387d7cd791a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5c9998-faa5-4685-85c6-22da9f9e8790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5c9998-faa5-4685-85c6-22da9f9e8790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd2d63fa-c32a-4322-af82-182a2235b044', 'volume_name': 'volume-dd2d63fa-c32a-4322-af82-182a2235b044', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1770b88f-e84a-4286-b488-9c59530429c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1770b88f-e84a-4286-b488-9c59530429c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f305809e-9b80-415b-814d-2c25e3a687e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Volume dd2d63fa-c32a-4322-af82-182a2235b044: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd2d63fa-c32a-4322-af82-182a2235b044', 'volume_size': 1} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Flow 'volume_create_manager' (4f7aa31a-253c-483b-99be-d58619208939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811e3525-a56e-4414-9dbe-839dc1f00b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811e3525-a56e-4414-9dbe-839dc1f00b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-540954227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f635c7f7-5583-4589-9fde-b8cc9084c394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7d2fa25f108464186dff1d0ddbef924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:58Z,use_quota=True,user_id='2feadb56e3ba4673beff8c3457738d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc16d15a-be45-4835-9758-5bf9a5d976ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc16d15a-be45-4835-9758-5bf9a5d976ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151d5993-7a30-4454-a929-c2dc6b0a579b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151d5993-7a30-4454-a929-c2dc6b0a579b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f635c7f7-5583-4589-9fde-b8cc9084c394', 'volume_name': 'volume-f635c7f7-5583-4589-9fde-b8cc9084c394', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de70161-80d4-48dd-9719-daf468b60f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6de70161-80d4-48dd-9719-daf468b60f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f7642c-9211-4f16-8677-6e1b93dabe42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Volume f635c7f7-5583-4589-9fde-b8cc9084c394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f635c7f7-5583-4589-9fde-b8cc9084c394', 'volume_size': 1} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Flow 'volume_create_manager' (521ae2af-079f-497e-a186-1746786c8712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89be51e9-efa9-4ec2-a12b-92eb3d79e412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89be51e9-efa9-4ec2-a12b-92eb3d79e412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-783395618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5844e5d-48d9-4c89-b56b-14af08e2c42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45396a1c0a674ff480fe92d2c1352bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:58Z,use_quota=True,user_id='8c875b868f794e6f984c658f47126c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72a568f-c3ae-49de-83bb-1f42e96cce94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72a568f-c3ae-49de-83bb-1f42e96cce94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51264d99-adc6-4e21-b603-c741e244068f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51264d99-adc6-4e21-b603-c741e244068f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5844e5d-48d9-4c89-b56b-14af08e2c42c', 'volume_name': 'volume-b5844e5d-48d9-4c89-b56b-14af08e2c42c', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a19683-c27a-46c2-b358-5461ac24f0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a19683-c27a-46c2-b358-5461ac24f0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437e2940-88f5-4fe8-b3ff-9c0672ef6533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Volume b5844e5d-48d9-4c89-b56b-14af08e2c42c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5844e5d-48d9-4c89-b56b-14af08e2c42c', 'volume_size': 1} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Flow 'volume_create_manager' (b05af7f9-bc59-4650-adb4-afc4e79067a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265dc3f4-d9db-468d-81a9-40e86a4ddf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265dc3f4-d9db-468d-81a9-40e86a4ddf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1862832163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e5b5afa-d461-489b-9209-e4def6997b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45396a1c0a674ff480fe92d2c1352bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:59Z,use_quota=True,user_id='8c875b868f794e6f984c658f47126c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b585f4-218e-4e22-ab71-1649cc9964ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b585f4-218e-4e22-ab71-1649cc9964ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e7f303-a71e-439b-96ac-8ede4aa417dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e7f303-a71e-439b-96ac-8ede4aa417dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e5b5afa-d461-489b-9209-e4def6997b09', 'volume_name': 'volume-3e5b5afa-d461-489b-9209-e4def6997b09', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2e47c3-4af2-4362-bd0e-10c72325e11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2e47c3-4af2-4362-bd0e-10c72325e11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6089ce1-f20d-49cf-8ce7-b8b365165e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Volume 3e5b5afa-d461-489b-9209-e4def6997b09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e5b5afa-d461-489b-9209-e4def6997b09', 'volume_size': 1} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Flow 'volume_create_manager' (482aa7e1-dfca-49c6-af81-5291fd4d8229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be32af9-39c7-4e32-96bd-0c5c1358b9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be32af9-39c7-4e32-96bd-0c5c1358b9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1501572359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5238c1-98bd-4ed5-89a3-228d05f0fecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45396a1c0a674ff480fe92d2c1352bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:59Z,use_quota=True,user_id='8c875b868f794e6f984c658f47126c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829e0452-b867-4c90-9755-c46581ad774d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829e0452-b867-4c90-9755-c46581ad774d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637cb043-d7ff-4957-b32d-713c8a2b4ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (637cb043-d7ff-4957-b32d-713c8a2b4ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b5238c1-98bd-4ed5-89a3-228d05f0fecd', 'volume_name': 'volume-2b5238c1-98bd-4ed5-89a3-228d05f0fecd', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e818a5-4181-4e77-996d-0b7290897d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e818a5-4181-4e77-996d-0b7290897d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd72a6ef-2867-45c4-a398-1efea8b3ae5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:59 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Volume 2b5238c1-98bd-4ed5-89a3-228d05f0fecd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b5238c1-98bd-4ed5-89a3-228d05f0fecd', 'volume_size': 1} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b 1073741824" returned: 0 in 0.966s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:59 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b Feb 27 02:10:59 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Flow 'volume_create_manager' (cfda0c55-6131-4a7f-8cd1-7d988857f88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2daf03fb-e339-4172-a6ad-1b57dff9eec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2daf03fb-e339-4172-a6ad-1b57dff9eec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-854314665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745af51e-2cff-4b53-9397-6fb206580124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45396a1c0a674ff480fe92d2c1352bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:59Z,use_quota=True,user_id='8c875b868f794e6f984c658f47126c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8423324e-d601-4b5d-9a79-e6df8ff43265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8423324e-d601-4b5d-9a79-e6df8ff43265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a645e9d2-e7c9-487e-9cfa-f672c73ab00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a645e9d2-e7c9-487e-9cfa-f672c73ab00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '745af51e-2cff-4b53-9397-6fb206580124', 'volume_name': 'volume-745af51e-2cff-4b53-9397-6fb206580124', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a70d1be-0c63-45d8-be96-0b356f36b3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a70d1be-0c63-45d8-be96-0b356f36b3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8c7d00-04e6-4790-80a6-372f33baa241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:59 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Volume 745af51e-2cff-4b53-9397-6fb206580124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-745af51e-2cff-4b53-9397-6fb206580124', 'volume_size': 1} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:59 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b" returned: 0 in 0.531s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.390s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-744397289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd2d63fa-c32a-4322-af82-182a2235b044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45396a1c0a674ff480fe92d2c1352bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:58Z,use_quota=True,user_id='8c875b868f794e6f984c658f47126c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Creating volume dd2d63fa-c32a-4322-af82-182a2235b044 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:10:59 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-dd2d63fa-c32a-4322-af82-182a2235b044 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e5c076-3e09-431a-8c19-abffa6a5ff1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78c109c5-c68e-4c84-88a7-6a742ff1850b', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e8859b-2eb9-4d03-b7ed-84aa6495496b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:10:59 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-dd2d63fa-c32a-4322-af82-182a2235b044 1073741824 Feb 27 02:10:59 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:10:59 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Volume volume-78c109c5-c68e-4c84-88a7-6a742ff1850b (78c109c5-c68e-4c84-88a7-6a742ff1850b): created successfully Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e8859b-2eb9-4d03-b7ed-84aa6495496b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:10:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Flow 'volume_create_manager' (1e4d7510-9763-4282-9fe5-2cd16f8980ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:10:59 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-d706cb7c-cebd-4ca9-b135-1f40156ad7bf tempest-CreateVolumesFromSnapshotTest-2102620973 None] Created volume successfully. Feb 27 02:11:00 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-dd2d63fa-c32a-4322-af82-182a2235b044 1073741824" returned: 0 in 0.600s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-dd2d63fa-c32a-4322-af82-182a2235b044 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:00 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-dd2d63fa-c32a-4322-af82-182a2235b044 Feb 27 02:11:00 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-721bb1e2-9fe2-4012-9d88-0125804959be tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:00 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-dd2d63fa-c32a-4322-af82-182a2235b044" returned: 0 in 0.505s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.250s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-540954227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f635c7f7-5583-4589-9fde-b8cc9084c394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7d2fa25f108464186dff1d0ddbef924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:58Z,use_quota=True,user_id='2feadb56e3ba4673beff8c3457738d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Creating volume f635c7f7-5583-4589-9fde-b8cc9084c394 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:00 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:11:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:00 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f305809e-9b80-415b-814d-2c25e3a687e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd2d63fa-c32a-4322-af82-182a2235b044', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:00 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae773c27-6cad-4ac4-9d74-13242c326426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:00 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394 1073741824 Feb 27 02:11:00 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:00 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Volume volume-dd2d63fa-c32a-4322-af82-182a2235b044 (dd2d63fa-c32a-4322-af82-182a2235b044): created successfully Feb 27 02:11:00 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae773c27-6cad-4ac4-9d74-13242c326426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:00 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Flow 'volume_create_manager' (ac8f8287-9494-438f-b9b7-6edbb589776a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:00 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-31fd5acf-2ccf-4e86-8867-4a5193bee7f8 tempest-CreateVolumesFromImageTest-1920984459 None] Created volume successfully. Feb 27 02:11:01 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394 1073741824" returned: 0 in 0.593s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:01 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394 Feb 27 02:11:01 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:01 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394" returned: 0 in 0.497s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.271s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-783395618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5844e5d-48d9-4c89-b56b-14af08e2c42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45396a1c0a674ff480fe92d2c1352bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:58Z,use_quota=True,user_id='8c875b868f794e6f984c658f47126c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Creating volume b5844e5d-48d9-4c89-b56b-14af08e2c42c {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:01 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:11:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b5844e5d-48d9-4c89-b56b-14af08e2c42c 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f7642c-9211-4f16-8677-6e1b93dabe42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f635c7f7-5583-4589-9fde-b8cc9084c394', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08827dd-ddba-4fdc-a6fb-fec67a59e814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:01 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b5844e5d-48d9-4c89-b56b-14af08e2c42c 1073741824 Feb 27 02:11:01 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:01 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Volume volume-f635c7f7-5583-4589-9fde-b8cc9084c394 (f635c7f7-5583-4589-9fde-b8cc9084c394): created successfully Feb 27 02:11:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08827dd-ddba-4fdc-a6fb-fec67a59e814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:01 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Flow 'volume_create_manager' (4f7aa31a-253c-483b-99be-d58619208939) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:01 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-5894a186-6893-4b03-9faf-287dc261e1e4 tempest-VolumeDependencyTests-1785253996 None] Created volume successfully. Feb 27 02:11:02 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b5844e5d-48d9-4c89-b56b-14af08e2c42c 1073741824" returned: 0 in 0.598s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b5844e5d-48d9-4c89-b56b-14af08e2c42c {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:02 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b5844e5d-48d9-4c89-b56b-14af08e2c42c Feb 27 02:11:02 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6da246c4-3bc9-4604-93a1-056dd86af94e tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:02 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b5844e5d-48d9-4c89-b56b-14af08e2c42c" returned: 0 in 0.526s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.275s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1862832163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e5b5afa-d461-489b-9209-e4def6997b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45396a1c0a674ff480fe92d2c1352bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:59Z,use_quota=True,user_id='8c875b868f794e6f984c658f47126c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Creating volume 3e5b5afa-d461-489b-9209-e4def6997b09 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:03 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:11:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e5b5afa-d461-489b-9209-e4def6997b09 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (437e2940-88f5-4fe8-b3ff-9c0672ef6533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5844e5d-48d9-4c89-b56b-14af08e2c42c', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900831f3-ecf2-489d-8ed7-a31b92d56b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:03 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e5b5afa-d461-489b-9209-e4def6997b09 1073741824 Feb 27 02:11:03 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:03 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Volume volume-b5844e5d-48d9-4c89-b56b-14af08e2c42c (b5844e5d-48d9-4c89-b56b-14af08e2c42c): created successfully Feb 27 02:11:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900831f3-ecf2-489d-8ed7-a31b92d56b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:03 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Flow 'volume_create_manager' (521ae2af-079f-497e-a186-1746786c8712) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:03 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-e0fe414e-84c1-408e-97a7-b04e2bc10601 tempest-CreateVolumesFromImageTest-1920984459 None] Created volume successfully. Feb 27 02:11:03 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e5b5afa-d461-489b-9209-e4def6997b09 1073741824" returned: 0 in 0.644s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e5b5afa-d461-489b-9209-e4def6997b09 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:03 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e5b5afa-d461-489b-9209-e4def6997b09 Feb 27 02:11:03 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:04 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e5b5afa-d461-489b-9209-e4def6997b09" returned: 0 in 0.528s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.211s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1501572359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5238c1-98bd-4ed5-89a3-228d05f0fecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45396a1c0a674ff480fe92d2c1352bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:59Z,use_quota=True,user_id='8c875b868f794e6f984c658f47126c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Creating volume 2b5238c1-98bd-4ed5-89a3-228d05f0fecd {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:04 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:11:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2b5238c1-98bd-4ed5-89a3-228d05f0fecd 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6089ce1-f20d-49cf-8ce7-b8b365165e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e5b5afa-d461-489b-9209-e4def6997b09', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb2565e-871b-46de-8ba5-b9337a185c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:04 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2b5238c1-98bd-4ed5-89a3-228d05f0fecd 1073741824 Feb 27 02:11:04 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:04 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Volume volume-3e5b5afa-d461-489b-9209-e4def6997b09 (3e5b5afa-d461-489b-9209-e4def6997b09): created successfully Feb 27 02:11:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb2565e-871b-46de-8ba5-b9337a185c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:04 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Flow 'volume_create_manager' (b05af7f9-bc59-4650-adb4-afc4e79067a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:04 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-07ad9b66-c43b-4ffd-8317-d4aec37b2d10 tempest-CreateVolumesFromImageTest-1920984459 None] Created volume successfully. Feb 27 02:11:04 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2b5238c1-98bd-4ed5-89a3-228d05f0fecd 1073741824" returned: 0 in 0.645s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2b5238c1-98bd-4ed5-89a3-228d05f0fecd {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:04 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2b5238c1-98bd-4ed5-89a3-228d05f0fecd Feb 27 02:11:04 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:05 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2b5238c1-98bd-4ed5-89a3-228d05f0fecd" returned: 0 in 0.534s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:05 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.061s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:05 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-854314665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745af51e-2cff-4b53-9397-6fb206580124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45396a1c0a674ff480fe92d2c1352bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:10:59Z,use_quota=True,user_id='8c875b868f794e6f984c658f47126c83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:05 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Creating volume 745af51e-2cff-4b53-9397-6fb206580124 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:05 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:05 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:05 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:05 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:11:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-745af51e-2cff-4b53-9397-6fb206580124 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:05 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd72a6ef-2867-45c4-a398-1efea8b3ae5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b5238c1-98bd-4ed5-89a3-228d05f0fecd', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:05 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-745af51e-2cff-4b53-9397-6fb206580124 1073741824 Feb 27 02:11:05 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a845384-e6d3-4a55-870f-d592749a3a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:05 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:05 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Volume volume-2b5238c1-98bd-4ed5-89a3-228d05f0fecd (2b5238c1-98bd-4ed5-89a3-228d05f0fecd): created successfully Feb 27 02:11:05 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a845384-e6d3-4a55-870f-d592749a3a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:05 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Flow 'volume_create_manager' (482aa7e1-dfca-49c6-af81-5291fd4d8229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:05 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-514afae6-dcfe-44c4-83f7-4aaf0fa24399 tempest-CreateVolumesFromImageTest-1920984459 None] Created volume successfully. Feb 27 02:11:06 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-745af51e-2cff-4b53-9397-6fb206580124 1073741824" returned: 0 in 0.685s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-745af51e-2cff-4b53-9397-6fb206580124 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:06 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-745af51e-2cff-4b53-9397-6fb206580124 Feb 27 02:11:06 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:06 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-745af51e-2cff-4b53-9397-6fb206580124" returned: 0 in 0.485s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:06 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-721bb1e2-9fe2-4012-9d88-0125804959be tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.384s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:06 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-721bb1e2-9fe2-4012-9d88-0125804959be tempest-CreateVolumesFromSnapshotTest-2102620973 None] Creating offline snapshot dcc6a61d-7401-48af-8dc0-edfdbec854ca of volume 78c109c5-c68e-4c84-88a7-6a742ff1850b {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:11:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8c7d00-04e6-4790-80a6-372f33baa241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-745af51e-2cff-4b53-9397-6fb206580124', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d883d1e0-90a7-44d3-9aab-ee75eab3581b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:06 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a94b81-b76f-4aa9-b0c0-dc3739e127d2]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-721bb1e2-9fe2-4012-9d88-0125804959be tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:06 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Volume volume-745af51e-2cff-4b53-9397-6fb206580124 (745af51e-2cff-4b53-9397-6fb206580124): created successfully Feb 27 02:11:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d883d1e0-90a7-44d3-9aab-ee75eab3581b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:06 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Flow 'volume_create_manager' (cfda0c55-6131-4a7f-8cd1-7d988857f88c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:06 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-10e444af-0c59-45ba-b818-206ef7954c95 tempest-CreateVolumesFromImageTest-1920984459 None] Created volume successfully. Feb 27 02:11:06 devstack sudo[90197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b Feb 27 02:11:06 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9ba49197-4c5b-448f-b193-f03f7c4d6188 tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "cinder-745af51e-2cff-4b53-9397-6fb206580124-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9ba49197-4c5b-448f-b193-f03f7c4d6188 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "cinder-745af51e-2cff-4b53-9397-6fb206580124-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9ba49197-4c5b-448f-b193-f03f7c4d6188 tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "cinder-quobyte-745af51e-2cff-4b53-9397-6fb206580124" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9ba49197-4c5b-448f-b193-f03f7c4d6188 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "cinder-quobyte-745af51e-2cff-4b53-9397-6fb206580124" acquired by "delete_volume" :: waited 0.008s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:07 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1810f5c2-38ad-46c8-980d-e57526e5fe4c]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9ba49197-4c5b-448f-b193-f03f7c4d6188 tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-745af51e-2cff-4b53-9397-6fb206580124 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:07 devstack sudo[90199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-745af51e-2cff-4b53-9397-6fb206580124 Feb 27 02:11:07 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:07 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-721bb1e2-9fe2-4012-9d88-0125804959be tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b" returned: 0 in 0.539s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-721bb1e2-9fe2-4012-9d88-0125804959be tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.dcc6a61d-7401-48af-8dc0-edfdbec854ca 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:07 devstack sudo[90204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.dcc6a61d-7401-48af-8dc0-edfdbec854ca 1G Feb 27 02:11:07 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:07 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9ba49197-4c5b-448f-b193-f03f7c4d6188 tempest-CreateVolumesFromImageTest-1920984459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-745af51e-2cff-4b53-9397-6fb206580124" returned: 0 in 0.520s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9ba49197-4c5b-448f-b193-f03f7c4d6188 tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-745af51e-2cff-4b53-9397-6fb206580124 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:07 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-745af51e-2cff-4b53-9397-6fb206580124 Feb 27 02:11:07 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:07 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-721bb1e2-9fe2-4012-9d88-0125804959be tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.dcc6a61d-7401-48af-8dc0-edfdbec854ca 1G" returned: 0 in 0.637s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-721bb1e2-9fe2-4012-9d88-0125804959be tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78c109c5-c68e-4c84-88a7-6a742ff1850b -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.dcc6a61d-7401-48af-8dc0-edfdbec854ca {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:07 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78c109c5-c68e-4c84-88a7-6a742ff1850b -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.dcc6a61d-7401-48af-8dc0-edfdbec854ca Feb 27 02:11:07 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:08 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9ba49197-4c5b-448f-b193-f03f7c4d6188 tempest-CreateVolumesFromImageTest-1920984459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-745af51e-2cff-4b53-9397-6fb206580124" returned: 0 in 0.591s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:08 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9ba49197-4c5b-448f-b193-f03f7c4d6188 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "cinder-quobyte-745af51e-2cff-4b53-9397-6fb206580124" released by "delete_volume" :: held 1.134s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:08 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-9ba49197-4c5b-448f-b193-f03f7c4d6188 tempest-CreateVolumesFromImageTest-1920984459 None] Created reservations ['0d42a8be-2ffb-4fd9-aec0-875dac417c67', '68e1a9f5-3422-4af3-9926-584cb3f3881f', 'a43cd855-9ad0-4278-8e48-215eede77fed', '2aa04061-7d64-4fa5-bb2e-e7d184080dce'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9ba49197-4c5b-448f-b193-f03f7c4d6188 tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9ba49197-4c5b-448f-b193-f03f7c4d6188 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:08 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-9ba49197-4c5b-448f-b193-f03f7c4d6188 tempest-CreateVolumesFromImageTest-1920984459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:08 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-9ba49197-4c5b-448f-b193-f03f7c4d6188 tempest-CreateVolumesFromImageTest-1920984459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9ba49197-4c5b-448f-b193-f03f7c4d6188 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9ba49197-4c5b-448f-b193-f03f7c4d6188 tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:08 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:11:08 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:08 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-721bb1e2-9fe2-4012-9d88-0125804959be tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78c109c5-c68e-4c84-88a7-6a742ff1850b -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.dcc6a61d-7401-48af-8dc0-edfdbec854ca" returned: 0 in 0.492s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:08 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-721bb1e2-9fe2-4012-9d88-0125804959be tempest-CreateVolumesFromSnapshotTest-2102620973 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.dcc6a61d-7401-48af-8dc0-edfdbec854ca is being set with open permissions: ugo+rw Feb 27 02:11:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-721bb1e2-9fe2-4012-9d88-0125804959be tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.dcc6a61d-7401-48af-8dc0-edfdbec854ca {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:08 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.dcc6a61d-7401-48af-8dc0-edfdbec854ca Feb 27 02:11:08 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:08 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9ba49197-4c5b-448f-b193-f03f7c4d6188 tempest-CreateVolumesFromImageTest-1920984459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.537s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:08 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-9ba49197-4c5b-448f-b193-f03f7c4d6188 tempest-CreateVolumesFromImageTest-1920984459 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:08 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-9ba49197-4c5b-448f-b193-f03f7c4d6188 tempest-CreateVolumesFromImageTest-1920984459 None] Deleted volume successfully. Feb 27 02:11:08 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9ba49197-4c5b-448f-b193-f03f7c4d6188 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "cinder-745af51e-2cff-4b53-9397-6fb206580124-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:08 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-721bb1e2-9fe2-4012-9d88-0125804959be tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.dcc6a61d-7401-48af-8dc0-edfdbec854ca" returned: 0 in 0.511s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-721bb1e2-9fe2-4012-9d88-0125804959be tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:08 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.info Feb 27 02:11:08 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:09 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3121c479-03dc-481a-8c51-6e12015183aa tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "cinder-2b5238c1-98bd-4ed5-89a3-228d05f0fecd-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:09 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3121c479-03dc-481a-8c51-6e12015183aa tempest-CreateVolumesFromImageTest-1920984459 None] Lock "cinder-2b5238c1-98bd-4ed5-89a3-228d05f0fecd-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:09 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3121c479-03dc-481a-8c51-6e12015183aa tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "cinder-quobyte-2b5238c1-98bd-4ed5-89a3-228d05f0fecd" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:09 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3121c479-03dc-481a-8c51-6e12015183aa tempest-CreateVolumesFromImageTest-1920984459 None] Lock "cinder-quobyte-2b5238c1-98bd-4ed5-89a3-228d05f0fecd" acquired by "delete_volume" :: waited 0.008s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:09 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[5beac914-c611-4667-9668-1aff0055e292]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3121c479-03dc-481a-8c51-6e12015183aa tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2b5238c1-98bd-4ed5-89a3-228d05f0fecd {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:09 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2b5238c1-98bd-4ed5-89a3-228d05f0fecd Feb 27 02:11:09 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:09 devstack cinder-volume[82683]: DEBUG oslo_service.periodic_task [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:11:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:09 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-721bb1e2-9fe2-4012-9d88-0125804959be tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.info" returned: 0 in 0.505s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:09 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-721bb1e2-9fe2-4012-9d88-0125804959be tempest-CreateVolumesFromSnapshotTest-2102620973 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.info is being set with open permissions: ugo+rw Feb 27 02:11:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-721bb1e2-9fe2-4012-9d88-0125804959be tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:09 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:11:09 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:09 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.info Feb 27 02:11:09 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:09 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3121c479-03dc-481a-8c51-6e12015183aa tempest-CreateVolumesFromImageTest-1920984459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2b5238c1-98bd-4ed5-89a3-228d05f0fecd" returned: 0 in 0.608s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3121c479-03dc-481a-8c51-6e12015183aa tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2b5238c1-98bd-4ed5-89a3-228d05f0fecd {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:09 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2b5238c1-98bd-4ed5-89a3-228d05f0fecd Feb 27 02:11:09 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:09 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.569s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:09 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:09 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-721bb1e2-9fe2-4012-9d88-0125804959be tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.info" returned: 0 in 0.571s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-721bb1e2-9fe2-4012-9d88-0125804959be tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.338s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6da246c4-3bc9-4604-93a1-056dd86af94e tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.279s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:10 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-6da246c4-3bc9-4604-93a1-056dd86af94e tempest-VolumeDependencyTests-1785253996 None] Creating offline snapshot 6011a921-6a58-4b36-9db3-bbacaf9a47ea of volume f635c7f7-5583-4589-9fde-b8cc9084c394 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:11:10 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4719d708-5728-477f-b9e6-846956a9ecac]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6da246c4-3bc9-4604-93a1-056dd86af94e tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:10 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-721bb1e2-9fe2-4012-9d88-0125804959be tempest-CreateVolumesFromSnapshotTest-2102620973 None] Create snapshot completed successfully Feb 27 02:11:10 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394 Feb 27 02:11:10 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:10 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3121c479-03dc-481a-8c51-6e12015183aa tempest-CreateVolumesFromImageTest-1920984459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-2b5238c1-98bd-4ed5-89a3-228d05f0fecd" returned: 0 in 0.489s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:10 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3121c479-03dc-481a-8c51-6e12015183aa tempest-CreateVolumesFromImageTest-1920984459 None] Lock "cinder-quobyte-2b5238c1-98bd-4ed5-89a3-228d05f0fecd" released by "delete_volume" :: held 1.122s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:10 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-3121c479-03dc-481a-8c51-6e12015183aa tempest-CreateVolumesFromImageTest-1920984459 None] Created reservations ['2a24e02c-dc61-40e6-8477-f582ac3415a0', 'a8c6af6b-b0b0-4d11-b6b9-a16f74c628f3', '2322f3e3-9397-42f7-8b85-049b696d468d', '49f16141-ad0e-4cc3-87cc-598f27ccd840'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3121c479-03dc-481a-8c51-6e12015183aa tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3121c479-03dc-481a-8c51-6e12015183aa tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:10 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-3121c479-03dc-481a-8c51-6e12015183aa tempest-CreateVolumesFromImageTest-1920984459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:10 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-3121c479-03dc-481a-8c51-6e12015183aa tempest-CreateVolumesFromImageTest-1920984459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3121c479-03dc-481a-8c51-6e12015183aa tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3121c479-03dc-481a-8c51-6e12015183aa tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:10 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:11:10 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:10 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6da246c4-3bc9-4604-93a1-056dd86af94e tempest-VolumeDependencyTests-1785253996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394" returned: 0 in 0.683s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:10 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6da246c4-3bc9-4604-93a1-056dd86af94e tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:10 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea 1G Feb 27 02:11:10 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Flow 'volume_create_manager' (3b88ceec-fff7-4ba0-b935-d94d14577915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9440de9c-d23b-4bbf-9a37-cc1831f2b239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9440de9c-d23b-4bbf-9a37-cc1831f2b239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-51168408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d30cd3dd-7c7f-443e-a577-5430cc612df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3737eb87ffae44c482b59cb3242336aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:11Z,use_quota=True,user_id='1ff8d624acd04a748397803df87d2520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:11 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe23fba-d373-41d8-9769-b1978f1018bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe23fba-d373-41d8-9769-b1978f1018bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3187a844-1553-435b-be32-33d056828d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3187a844-1553-435b-be32-33d056828d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd30cd3dd-7c7f-443e-a577-5430cc612df5', 'volume_name': 'volume-d30cd3dd-7c7f-443e-a577-5430cc612df5', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (535cc444-14ae-4060-b2b3-fcac9bf9610f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (535cc444-14ae-4060-b2b3-fcac9bf9610f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f662e2a-737d-41e6-8215-8c20589b96f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:11 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Volume d30cd3dd-7c7f-443e-a577-5430cc612df5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d30cd3dd-7c7f-443e-a577-5430cc612df5', 'volume_size': 1} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3121c479-03dc-481a-8c51-6e12015183aa tempest-CreateVolumesFromImageTest-1920984459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.755s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-3121c479-03dc-481a-8c51-6e12015183aa tempest-CreateVolumesFromImageTest-1920984459 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:11 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-3121c479-03dc-481a-8c51-6e12015183aa tempest-CreateVolumesFromImageTest-1920984459 None] Deleted volume successfully. Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3121c479-03dc-481a-8c51-6e12015183aa tempest-CreateVolumesFromImageTest-1920984459 None] Lock "cinder-2b5238c1-98bd-4ed5-89a3-228d05f0fecd-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2de1a081-d7bd-49d1-9111-b4dac7fc5e2e tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "cinder-3e5b5afa-d461-489b-9209-e4def6997b09-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2de1a081-d7bd-49d1-9111-b4dac7fc5e2e tempest-CreateVolumesFromImageTest-1920984459 None] Lock "cinder-3e5b5afa-d461-489b-9209-e4def6997b09-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Flow 'volume_create_manager' (52f8b681-e05a-471f-a551-a1bb8d4bb52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b422a3-9276-4245-8f39-883a94a84813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2de1a081-d7bd-49d1-9111-b4dac7fc5e2e tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "cinder-quobyte-3e5b5afa-d461-489b-9209-e4def6997b09" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b422a3-9276-4245-8f39-883a94a84813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-903545224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac93c34f-75a1-4054-9f11-86e292393fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3737eb87ffae44c482b59cb3242336aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:11Z,use_quota=True,user_id='1ff8d624acd04a748397803df87d2520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e946eb-0fbc-45e2-8386-25b70e67d341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e946eb-0fbc-45e2-8386-25b70e67d341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578c5729-0d90-40b0-b2c5-7766b2880b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578c5729-0d90-40b0-b2c5-7766b2880b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac93c34f-75a1-4054-9f11-86e292393fa9', 'volume_name': 'volume-ac93c34f-75a1-4054-9f11-86e292393fa9', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad51aa84-0103-4125-9d4c-17a0d20c8dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad51aa84-0103-4125-9d4c-17a0d20c8dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e851ad-bdb9-48be-be23-0a021ddcc012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:11 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Volume ac93c34f-75a1-4054-9f11-86e292393fa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac93c34f-75a1-4054-9f11-86e292393fa9', 'volume_size': 1} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2de1a081-d7bd-49d1-9111-b4dac7fc5e2e tempest-CreateVolumesFromImageTest-1920984459 None] Lock "cinder-quobyte-3e5b5afa-d461-489b-9209-e4def6997b09" acquired by "delete_volume" :: waited 0.078s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f346a8ff-5459-4a0a-92b0-5131fe7d8245]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2de1a081-d7bd-49d1-9111-b4dac7fc5e2e tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e5b5afa-d461-489b-9209-e4def6997b09 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:11 devstack sudo[90297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e5b5afa-d461-489b-9209-e4def6997b09 Feb 27 02:11:11 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:11 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6da246c4-3bc9-4604-93a1-056dd86af94e tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea 1G" returned: 0 in 1.129s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6da246c4-3bc9-4604-93a1-056dd86af94e tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f635c7f7-5583-4589-9fde-b8cc9084c394 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:11 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f635c7f7-5583-4589-9fde-b8cc9084c394 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea Feb 27 02:11:11 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Flow 'volume_create_manager' (e694a6d9-a7e1-48db-8053-36a8dc3f9d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9714104-ad83-4fc9-83c8-310f0bf124fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9714104-ad83-4fc9-83c8-310f0bf124fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-138501174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a183139b-5f5c-45e3-966e-5674afbf2c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3737eb87ffae44c482b59cb3242336aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:12Z,use_quota=True,user_id='1ff8d624acd04a748397803df87d2520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5fc192-b71e-4dbc-aa1a-40cd978fa65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b5fc192-b71e-4dbc-aa1a-40cd978fa65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:11 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf1ae8e-4191-406d-90c7-55f5b4012454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf1ae8e-4191-406d-90c7-55f5b4012454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a183139b-5f5c-45e3-966e-5674afbf2c22', 'volume_name': 'volume-a183139b-5f5c-45e3-966e-5674afbf2c22', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d8d412-f4ae-4a27-b8b6-e639c646edb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d8d412-f4ae-4a27-b8b6-e639c646edb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0759b1d-7b84-42e0-a0fa-1785d546e6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:12 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Volume a183139b-5f5c-45e3-966e-5674afbf2c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a183139b-5f5c-45e3-966e-5674afbf2c22', 'volume_size': 1} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Flow 'volume_create_manager' (cae91ed3-f716-4e2e-91d5-fe76ed91adf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819c181f-eada-4d84-b16a-49fcce08bbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819c181f-eada-4d84-b16a-49fcce08bbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-17530985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3be84e0-db7e-4430-b7f5-9b2900d37a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3737eb87ffae44c482b59cb3242336aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:12Z,use_quota=True,user_id='1ff8d624acd04a748397803df87d2520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ba109d-c459-4169-9e03-796071ff2c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ba109d-c459-4169-9e03-796071ff2c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d24d72dc-ee17-48b3-a20b-75a8e83c444d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d24d72dc-ee17-48b3-a20b-75a8e83c444d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3be84e0-db7e-4430-b7f5-9b2900d37a24', 'volume_name': 'volume-a3be84e0-db7e-4430-b7f5-9b2900d37a24', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73131518-2cde-47ca-b961-dc4bbebfb149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73131518-2cde-47ca-b961-dc4bbebfb149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4cc2bb-581e-4cc3-a869-160e5bd76d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:12 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Volume a3be84e0-db7e-4430-b7f5-9b2900d37a24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3be84e0-db7e-4430-b7f5-9b2900d37a24', 'volume_size': 1} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Flow 'volume_create_manager' (0fc577ca-8a41-48fa-86cd-71b4c9203040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b80551-b445-4698-a3ff-f6cef9c2bc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b80551-b445-4698-a3ff-f6cef9c2bc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-774418968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc2489a1-ab7e-4f84-87f2-e269c3543158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3737eb87ffae44c482b59cb3242336aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:13Z,use_quota=True,user_id='1ff8d624acd04a748397803df87d2520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97c76f6-f678-4e3b-b09e-045f68e24384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d97c76f6-f678-4e3b-b09e-045f68e24384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29867fe-8d9a-4f0f-bd73-1b3f7b681f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29867fe-8d9a-4f0f-bd73-1b3f7b681f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc2489a1-ab7e-4f84-87f2-e269c3543158', 'volume_name': 'volume-bc2489a1-ab7e-4f84-87f2-e269c3543158', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8ff055-792f-4628-8a1c-ee25fb0c1170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8ff055-792f-4628-8a1c-ee25fb0c1170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d69721-06d6-48bc-b23f-1fe790c8e31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:12 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Volume bc2489a1-ab7e-4f84-87f2-e269c3543158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc2489a1-ab7e-4f84-87f2-e269c3543158', 'volume_size': 1} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:12 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2de1a081-d7bd-49d1-9111-b4dac7fc5e2e tempest-CreateVolumesFromImageTest-1920984459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e5b5afa-d461-489b-9209-e4def6997b09" returned: 0 in 1.074s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2de1a081-d7bd-49d1-9111-b4dac7fc5e2e tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e5b5afa-d461-489b-9209-e4def6997b09 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:12 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e5b5afa-d461-489b-9209-e4def6997b09 Feb 27 02:11:12 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:12 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6da246c4-3bc9-4604-93a1-056dd86af94e tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f635c7f7-5583-4589-9fde-b8cc9084c394 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea" returned: 0 in 1.089s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:12 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-6da246c4-3bc9-4604-93a1-056dd86af94e tempest-VolumeDependencyTests-1785253996 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea is being set with open permissions: ugo+rw Feb 27 02:11:12 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6da246c4-3bc9-4604-93a1-056dd86af94e tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:12 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea Feb 27 02:11:12 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:13 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2de1a081-d7bd-49d1-9111-b4dac7fc5e2e tempest-CreateVolumesFromImageTest-1920984459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-3e5b5afa-d461-489b-9209-e4def6997b09" returned: 0 in 0.482s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2de1a081-d7bd-49d1-9111-b4dac7fc5e2e tempest-CreateVolumesFromImageTest-1920984459 None] Lock "cinder-quobyte-3e5b5afa-d461-489b-9209-e4def6997b09" released by "delete_volume" :: held 1.583s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:13 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-2de1a081-d7bd-49d1-9111-b4dac7fc5e2e tempest-CreateVolumesFromImageTest-1920984459 None] Created reservations ['cf9b08af-f3fb-484e-b19c-c83af551f983', '27acf0f1-b91d-4b1b-8d50-75981de33a5d', '47dd827f-41e5-4f63-b666-ae225c367ee0', 'bbbe4f3c-43d8-4c0c-b546-9d7e49d5ccee'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2de1a081-d7bd-49d1-9111-b4dac7fc5e2e tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2de1a081-d7bd-49d1-9111-b4dac7fc5e2e tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2de1a081-d7bd-49d1-9111-b4dac7fc5e2e tempest-CreateVolumesFromImageTest-1920984459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:13 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2de1a081-d7bd-49d1-9111-b4dac7fc5e2e tempest-CreateVolumesFromImageTest-1920984459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2de1a081-d7bd-49d1-9111-b4dac7fc5e2e tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2de1a081-d7bd-49d1-9111-b4dac7fc5e2e tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:13 devstack sudo[90313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:11:13 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:13 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6da246c4-3bc9-4604-93a1-056dd86af94e tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea" returned: 0 in 0.551s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6da246c4-3bc9-4604-93a1-056dd86af94e tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:13 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.info Feb 27 02:11:13 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5e09042d-aa71-43f9-88f3-843465f28c46 tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "cinder-b5844e5d-48d9-4c89-b56b-14af08e2c42c-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5e09042d-aa71-43f9-88f3-843465f28c46 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "cinder-b5844e5d-48d9-4c89-b56b-14af08e2c42c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5e09042d-aa71-43f9-88f3-843465f28c46 tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "cinder-quobyte-b5844e5d-48d9-4c89-b56b-14af08e2c42c" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5e09042d-aa71-43f9-88f3-843465f28c46 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "cinder-quobyte-b5844e5d-48d9-4c89-b56b-14af08e2c42c" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:13 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f05399e-0b80-466e-9e16-80b40ec9e6a9]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5e09042d-aa71-43f9-88f3-843465f28c46 tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b5844e5d-48d9-4c89-b56b-14af08e2c42c {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:13 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:13 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2de1a081-d7bd-49d1-9111-b4dac7fc5e2e tempest-CreateVolumesFromImageTest-1920984459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.604s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:13 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-2de1a081-d7bd-49d1-9111-b4dac7fc5e2e tempest-CreateVolumesFromImageTest-1920984459 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:13 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-2de1a081-d7bd-49d1-9111-b4dac7fc5e2e tempest-CreateVolumesFromImageTest-1920984459 None] Deleted volume successfully. Feb 27 02:11:13 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2de1a081-d7bd-49d1-9111-b4dac7fc5e2e tempest-CreateVolumesFromImageTest-1920984459 None] Lock "cinder-3e5b5afa-d461-489b-9209-e4def6997b09-delete_volume" released by "delete_volume" :: held 2.538s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:14 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b5844e5d-48d9-4c89-b56b-14af08e2c42c Feb 27 02:11:14 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:14 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6da246c4-3bc9-4604-93a1-056dd86af94e tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.info" returned: 0 in 0.664s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:14 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-6da246c4-3bc9-4604-93a1-056dd86af94e tempest-VolumeDependencyTests-1785253996 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.info is being set with open permissions: ugo+rw Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6da246c4-3bc9-4604-93a1-056dd86af94e tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:14 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.info Feb 27 02:11:14 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:14 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5e09042d-aa71-43f9-88f3-843465f28c46 tempest-CreateVolumesFromImageTest-1920984459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b5844e5d-48d9-4c89-b56b-14af08e2c42c" returned: 0 in 0.721s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5e09042d-aa71-43f9-88f3-843465f28c46 tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b5844e5d-48d9-4c89-b56b-14af08e2c42c {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:14 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b5844e5d-48d9-4c89-b56b-14af08e2c42c Feb 27 02:11:14 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:14 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6da246c4-3bc9-4604-93a1-056dd86af94e tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.info" returned: 0 in 0.611s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6da246c4-3bc9-4604-93a1-056dd86af94e tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.823s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.560s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-51168408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d30cd3dd-7c7f-443e-a577-5430cc612df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3737eb87ffae44c482b59cb3242336aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:11Z,use_quota=True,user_id='1ff8d624acd04a748397803df87d2520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Creating volume d30cd3dd-7c7f-443e-a577-5430cc612df5 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:14 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d30cd3dd-7c7f-443e-a577-5430cc612df5 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:14 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d30cd3dd-7c7f-443e-a577-5430cc612df5 1073741824 Feb 27 02:11:14 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Flow 'volume_create_manager' (f7528ee3-732b-420b-a9b5-95867281466e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203360f4-1437-44fe-817d-4eaaa1f753f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:14 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-6da246c4-3bc9-4604-93a1-056dd86af94e tempest-VolumeDependencyTests-1785253996 None] Create snapshot completed successfully Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203360f4-1437-44fe-817d-4eaaa1f753f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-224502532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36a0d49-2a15-4d64-9387-e20cd9d157cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1852f65ec35446cbb33f9a1ba1e08078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:15Z,use_quota=True,user_id='dbf3238bf65449f28ba319f97e2972e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f1956b-754a-450b-91cc-ce03019cbca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f1956b-754a-450b-91cc-ce03019cbca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95eba9d9-040d-44c5-8cc1-cd0d58475b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95eba9d9-040d-44c5-8cc1-cd0d58475b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f36a0d49-2a15-4d64-9387-e20cd9d157cf', 'volume_name': 'volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6120eb1-1827-42a2-a062-72611729e3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6120eb1-1827-42a2-a062-72611729e3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5aede3-e2a7-43f1-9011-363ee3e0bcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:14 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Volume f36a0d49-2a15-4d64-9387-e20cd9d157cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf', 'volume_size': 1} Feb 27 02:11:14 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:15 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5e09042d-aa71-43f9-88f3-843465f28c46 tempest-CreateVolumesFromImageTest-1920984459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b5844e5d-48d9-4c89-b56b-14af08e2c42c" returned: 0 in 0.482s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5e09042d-aa71-43f9-88f3-843465f28c46 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "cinder-quobyte-b5844e5d-48d9-4c89-b56b-14af08e2c42c" released by "delete_volume" :: held 1.235s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-5e09042d-aa71-43f9-88f3-843465f28c46 tempest-CreateVolumesFromImageTest-1920984459 None] Created reservations ['fcf601c1-32db-4cbd-98ae-03c454d210ba', 'f22c6cda-dc58-49b6-8c64-3628444a696e', '548ddc8e-29db-4d2e-baaf-6fc7488ddeab', '2424f38f-8201-4047-aaa3-f8ee78297800'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5e09042d-aa71-43f9-88f3-843465f28c46 tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5e09042d-aa71-43f9-88f3-843465f28c46 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5e09042d-aa71-43f9-88f3-843465f28c46 tempest-CreateVolumesFromImageTest-1920984459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-5e09042d-aa71-43f9-88f3-843465f28c46 tempest-CreateVolumesFromImageTest-1920984459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-5e09042d-aa71-43f9-88f3-843465f28c46 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5e09042d-aa71-43f9-88f3-843465f28c46 tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:15 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:11:15 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:15 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d30cd3dd-7c7f-443e-a577-5430cc612df5 1073741824" returned: 0 in 0.679s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Flow 'volume_create_manager' (1e314a5b-6543-44f6-b01a-c7ae7e00a4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bfc4954-0b75-4ebb-a4e7-caacd994a60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bfc4954-0b75-4ebb-a4e7-caacd994a60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2064915997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b620ac97-fea0-41cb-beb4-93859299e74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7d2fa25f108464186dff1d0ddbef924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6011a921-6a58-4b36-9db3-bbacaf9a47ea,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:15Z,use_quota=True,user_id='2feadb56e3ba4673beff8c3457738d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1b4f4d-54e1-45cc-b782-df2e6f2e9fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1b4f4d-54e1-45cc-b782-df2e6f2e9fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78ec0ed-7e40-4ac2-aa67-9da9534971a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78ec0ed-7e40-4ac2-aa67-9da9534971a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b620ac97-fea0-41cb-beb4-93859299e74e', 'volume_name': 'volume-b620ac97-fea0-41cb-beb4-93859299e74e', 'volume_size': 1, 'snapshot_id': '6011a921-6a58-4b36-9db3-bbacaf9a47ea'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8065cf-45d5-41f7-82fa-935552e53017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd8065cf-45d5-41f7-82fa-935552e53017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c5d4f37-2a9a-4807-abe6-b7420f86345d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:15 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Volume b620ac97-fea0-41cb-beb4-93859299e74e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b620ac97-fea0-41cb-beb4-93859299e74e', 'volume_size': 1, 'snapshot_id': '6011a921-6a58-4b36-9db3-bbacaf9a47ea'} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d30cd3dd-7c7f-443e-a577-5430cc612df5 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:15 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d30cd3dd-7c7f-443e-a577-5430cc612df5 Feb 27 02:11:15 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:15 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-5e09042d-aa71-43f9-88f3-843465f28c46 tempest-CreateVolumesFromImageTest-1920984459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.467s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-5e09042d-aa71-43f9-88f3-843465f28c46 tempest-CreateVolumesFromImageTest-1920984459 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:15 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-5e09042d-aa71-43f9-88f3-843465f28c46 tempest-CreateVolumesFromImageTest-1920984459 None] Deleted volume successfully. Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-5e09042d-aa71-43f9-88f3-843465f28c46 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "cinder-b5844e5d-48d9-4c89-b56b-14af08e2c42c-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4aeaed73-cc6a-46ae-ad4b-30993f2e4a08 tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "cinder-dd2d63fa-c32a-4322-af82-182a2235b044-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:15 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4aeaed73-cc6a-46ae-ad4b-30993f2e4a08 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "cinder-dd2d63fa-c32a-4322-af82-182a2235b044-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4aeaed73-cc6a-46ae-ad4b-30993f2e4a08 tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "cinder-quobyte-dd2d63fa-c32a-4322-af82-182a2235b044" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4aeaed73-cc6a-46ae-ad4b-30993f2e4a08 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "cinder-quobyte-dd2d63fa-c32a-4322-af82-182a2235b044" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce20ee8-df30-4603-ac20-82566de24a92]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:16 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4aeaed73-cc6a-46ae-ad4b-30993f2e4a08 tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-dd2d63fa-c32a-4322-af82-182a2235b044 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d30cd3dd-7c7f-443e-a577-5430cc612df5" returned: 0 in 0.421s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.443s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-903545224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac93c34f-75a1-4054-9f11-86e292393fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3737eb87ffae44c482b59cb3242336aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:11Z,use_quota=True,user_id='1ff8d624acd04a748397803df87d2520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Creating volume ac93c34f-75a1-4054-9f11-86e292393fa9 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:16 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ac93c34f-75a1-4054-9f11-86e292393fa9 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f662e2a-737d-41e6-8215-8c20589b96f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d30cd3dd-7c7f-443e-a577-5430cc612df5', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79385366-3762-4fb2-998c-1071c4d411ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:16 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ac93c34f-75a1-4054-9f11-86e292393fa9 1073741824 Feb 27 02:11:16 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:16 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Volume volume-d30cd3dd-7c7f-443e-a577-5430cc612df5 (d30cd3dd-7c7f-443e-a577-5430cc612df5): created successfully Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79385366-3762-4fb2-998c-1071c4d411ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Flow 'volume_create_manager' (3b88ceec-fff7-4ba0-b935-d94d14577915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:16 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-2aae4dee-f3db-4c3a-9b64-3fd0b2385add tempest-CreateVolumesFromSnapshotTest-2102620973 None] Created volume successfully. Feb 27 02:11:16 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-dd2d63fa-c32a-4322-af82-182a2235b044 Feb 27 02:11:16 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:16 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ac93c34f-75a1-4054-9f11-86e292393fa9 1073741824" returned: 0 in 0.596s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:16 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4aeaed73-cc6a-46ae-ad4b-30993f2e4a08 tempest-CreateVolumesFromImageTest-1920984459 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-dd2d63fa-c32a-4322-af82-182a2235b044" returned: 0 in 0.631s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4aeaed73-cc6a-46ae-ad4b-30993f2e4a08 tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-dd2d63fa-c32a-4322-af82-182a2235b044 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:16 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-dd2d63fa-c32a-4322-af82-182a2235b044 Feb 27 02:11:16 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:16 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ac93c34f-75a1-4054-9f11-86e292393fa9 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:16 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ac93c34f-75a1-4054-9f11-86e292393fa9 Feb 27 02:11:16 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:17 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ac93c34f-75a1-4054-9f11-86e292393fa9" returned: 0 in 0.546s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.231s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-138501174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a183139b-5f5c-45e3-966e-5674afbf2c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3737eb87ffae44c482b59cb3242336aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:12Z,use_quota=True,user_id='1ff8d624acd04a748397803df87d2520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Creating volume a183139b-5f5c-45e3-966e-5674afbf2c22 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:17 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a183139b-5f5c-45e3-966e-5674afbf2c22 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:17 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e851ad-bdb9-48be-be23-0a021ddcc012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac93c34f-75a1-4054-9f11-86e292393fa9', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7cf0537-66bd-4e5e-ad8a-f18b6cd4cc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4aeaed73-cc6a-46ae-ad4b-30993f2e4a08 tempest-CreateVolumesFromImageTest-1920984459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-dd2d63fa-c32a-4322-af82-182a2235b044" returned: 0 in 0.618s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:17 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a183139b-5f5c-45e3-966e-5674afbf2c22 1073741824 Feb 27 02:11:17 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:17 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Volume volume-ac93c34f-75a1-4054-9f11-86e292393fa9 (ac93c34f-75a1-4054-9f11-86e292393fa9): created successfully Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7cf0537-66bd-4e5e-ad8a-f18b6cd4cc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Flow 'volume_create_manager' (52f8b681-e05a-471f-a551-a1bb8d4bb52a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4aeaed73-cc6a-46ae-ad4b-30993f2e4a08 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "cinder-quobyte-dd2d63fa-c32a-4322-af82-182a2235b044" released by "delete_volume" :: held 1.286s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:17 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-b9a7e815-4503-40ec-bd39-8fe51f9f1881 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Created volume successfully. Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-4aeaed73-cc6a-46ae-ad4b-30993f2e4a08 tempest-CreateVolumesFromImageTest-1920984459 None] Created reservations ['9c8ade98-b8fd-40e0-9ca8-fbc8fd668bf8', 'e92e7bee-30a2-4d6a-833c-669a6b9b442f', 'a9ebb1a1-9a0e-4e3f-a035-5ba2790c9b24', 'ec76d8a6-b5d3-4a82-aaac-482f5e3666d3'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4aeaed73-cc6a-46ae-ad4b-30993f2e4a08 tempest-CreateVolumesFromImageTest-1920984459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4aeaed73-cc6a-46ae-ad4b-30993f2e4a08 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4aeaed73-cc6a-46ae-ad4b-30993f2e4a08 tempest-CreateVolumesFromImageTest-1920984459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4aeaed73-cc6a-46ae-ad4b-30993f2e4a08 tempest-CreateVolumesFromImageTest-1920984459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4aeaed73-cc6a-46ae-ad4b-30993f2e4a08 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4aeaed73-cc6a-46ae-ad4b-30993f2e4a08 tempest-CreateVolumesFromImageTest-1920984459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:17 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:11:17 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:17 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a183139b-5f5c-45e3-966e-5674afbf2c22 1073741824" returned: 0 in 0.650s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:17 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a183139b-5f5c-45e3-966e-5674afbf2c22 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:17 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a183139b-5f5c-45e3-966e-5674afbf2c22 Feb 27 02:11:17 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:18 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4aeaed73-cc6a-46ae-ad4b-30993f2e4a08 tempest-CreateVolumesFromImageTest-1920984459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.584s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:18 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-4aeaed73-cc6a-46ae-ad4b-30993f2e4a08 tempest-CreateVolumesFromImageTest-1920984459 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:18 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-4aeaed73-cc6a-46ae-ad4b-30993f2e4a08 tempest-CreateVolumesFromImageTest-1920984459 None] Deleted volume successfully. Feb 27 02:11:18 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4aeaed73-cc6a-46ae-ad4b-30993f2e4a08 tempest-CreateVolumesFromImageTest-1920984459 None] Lock "cinder-dd2d63fa-c32a-4322-af82-182a2235b044-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:18 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a183139b-5f5c-45e3-966e-5674afbf2c22" returned: 0 in 0.511s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:18 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.042s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:18 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-17530985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3be84e0-db7e-4430-b7f5-9b2900d37a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3737eb87ffae44c482b59cb3242336aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:12Z,use_quota=True,user_id='1ff8d624acd04a748397803df87d2520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:18 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Creating volume a3be84e0-db7e-4430-b7f5-9b2900d37a24 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:18 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:18 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:18 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:18 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:11:18 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a3be84e0-db7e-4430-b7f5-9b2900d37a24 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:18 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0759b1d-7b84-42e0-a0fa-1785d546e6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a183139b-5f5c-45e3-966e-5674afbf2c22', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:18 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f0b704c-cebb-4037-b6e4-b51e6617c21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:18 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a3be84e0-db7e-4430-b7f5-9b2900d37a24 1073741824 Feb 27 02:11:18 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:18 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Volume volume-a183139b-5f5c-45e3-966e-5674afbf2c22 (a183139b-5f5c-45e3-966e-5674afbf2c22): created successfully Feb 27 02:11:18 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f0b704c-cebb-4037-b6e4-b51e6617c21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:18 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Flow 'volume_create_manager' (e694a6d9-a7e1-48db-8053-36a8dc3f9d59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:18 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-4e6100e3-678d-429f-8600-e44215d7de1d tempest-CreateVolumesFromSnapshotTest-2102620973 None] Created volume successfully. Feb 27 02:11:19 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a3be84e0-db7e-4430-b7f5-9b2900d37a24 1073741824" returned: 0 in 0.632s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a3be84e0-db7e-4430-b7f5-9b2900d37a24 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:19 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a3be84e0-db7e-4430-b7f5-9b2900d37a24 Feb 27 02:11:19 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:19 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a3be84e0-db7e-4430-b7f5-9b2900d37a24" returned: 0 in 0.562s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.026s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-774418968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc2489a1-ab7e-4f84-87f2-e269c3543158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3737eb87ffae44c482b59cb3242336aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:13Z,use_quota=True,user_id='1ff8d624acd04a748397803df87d2520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Creating volume bc2489a1-ab7e-4f84-87f2-e269c3543158 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:19 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:19 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:11:19 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bc2489a1-ab7e-4f84-87f2-e269c3543158 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4cc2bb-581e-4cc3-a869-160e5bd76d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3be84e0-db7e-4430-b7f5-9b2900d37a24', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850f1a0e-6f0b-4e13-b6e8-d2d24c44e6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:19 devstack sudo[90378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bc2489a1-ab7e-4f84-87f2-e269c3543158 1073741824 Feb 27 02:11:19 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:19 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Volume volume-a3be84e0-db7e-4430-b7f5-9b2900d37a24 (a3be84e0-db7e-4430-b7f5-9b2900d37a24): created successfully Feb 27 02:11:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850f1a0e-6f0b-4e13-b6e8-d2d24c44e6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:19 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Flow 'volume_create_manager' (cae91ed3-f716-4e2e-91d5-fe76ed91adf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:19 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-2dbf0a5c-14d5-4ca1-bfa2-917d1d631e05 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Created volume successfully. Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Flow 'volume_create_manager' (70a41287-c093-44ac-8a3a-570e6c7819a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc4cccb-9afb-451a-8f32-2e03b109c878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc4cccb-9afb-451a-8f32-2e03b109c878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d912065-cfb4-4008-8f65-0822b62cd837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1585d832707496f892634b86981e189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:20Z,use_quota=True,user_id='2750359a04a04e9c93b3f90124038ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2c2fdf-4c20-4c54-9c00-2c5a5ce21ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2c2fdf-4c20-4c54-9c00-2c5a5ce21ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb2b2efc-8a87-4386-bb9b-af27af4162db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb2b2efc-8a87-4386-bb9b-af27af4162db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d912065-cfb4-4008-8f65-0822b62cd837', 'volume_name': 'volume-0d912065-cfb4-4008-8f65-0822b62cd837', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10941a59-390e-411f-ba52-7ddf84c89bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10941a59-390e-411f-ba52-7ddf84c89bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd32fdf-36b2-46e2-9b80-2931a615d817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:20 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Volume 0d912065-cfb4-4008-8f65-0822b62cd837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d912065-cfb4-4008-8f65-0822b62cd837', 'volume_size': 1} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:20 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bc2489a1-ab7e-4f84-87f2-e269c3543158 1073741824" returned: 0 in 0.697s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bc2489a1-ab7e-4f84-87f2-e269c3543158 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:20 devstack sudo[90383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bc2489a1-ab7e-4f84-87f2-e269c3543158 Feb 27 02:11:20 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:20 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bc2489a1-ab7e-4f84-87f2-e269c3543158" returned: 0 in 0.430s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.926s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-224502532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36a0d49-2a15-4d64-9387-e20cd9d157cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1852f65ec35446cbb33f9a1ba1e08078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:15Z,use_quota=True,user_id='dbf3238bf65449f28ba319f97e2972e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Creating volume f36a0d49-2a15-4d64-9387-e20cd9d157cf {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:20 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:20 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf 1073741824 Feb 27 02:11:20 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d69721-06d6-48bc-b23f-1fe790c8e31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc2489a1-ab7e-4f84-87f2-e269c3543158', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d03d8a-88d5-4d7f-96f4-e012dbc85404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:20 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Volume volume-bc2489a1-ab7e-4f84-87f2-e269c3543158 (bc2489a1-ab7e-4f84-87f2-e269c3543158): created successfully Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d03d8a-88d5-4d7f-96f4-e012dbc85404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:20 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Flow 'volume_create_manager' (0fc577ca-8a41-48fa-86cd-71b4c9203040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:20 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-40539cdf-f823-4029-a955-2b54eb66dd5b tempest-CreateVolumesFromSnapshotTest-2102620973 None] Created volume successfully. Feb 27 02:11:21 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf 1073741824" returned: 0 in 0.560s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:21 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3d958df5-eea1-46eb-9d81-3e2073b12f3c tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "cinder-bc2489a1-ab7e-4f84-87f2-e269c3543158-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:21 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3d958df5-eea1-46eb-9d81-3e2073b12f3c tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-bc2489a1-ab7e-4f84-87f2-e269c3543158-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:21 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf Feb 27 02:11:21 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:21 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3d958df5-eea1-46eb-9d81-3e2073b12f3c tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "cinder-quobyte-bc2489a1-ab7e-4f84-87f2-e269c3543158" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:21 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3d958df5-eea1-46eb-9d81-3e2073b12f3c tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-quobyte-bc2489a1-ab7e-4f84-87f2-e269c3543158" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:21 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[028b70b2-88d0-4358-8335-2070bd2697a4]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:21 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3d958df5-eea1-46eb-9d81-3e2073b12f3c tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bc2489a1-ab7e-4f84-87f2-e269c3543158 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:21 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bc2489a1-ab7e-4f84-87f2-e269c3543158 Feb 27 02:11:21 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:22 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf" returned: 0 in 0.554s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.456s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "cinder-quobyte-6011a921-6a58-4b36-9db3-bbacaf9a47ea-b620ac97-fea0-41cb-beb4-93859299e74e" by "_create_volume_from_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5aede3-e2a7-43f1-9011-363ee3e0bcf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:22 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33827b0e-6cdd-4ebd-9ef3-c30b8b45215f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3d958df5-eea1-46eb-9d81-3e2073b12f3c tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bc2489a1-ab7e-4f84-87f2-e269c3543158" returned: 0 in 0.545s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3d958df5-eea1-46eb-9d81-3e2073b12f3c tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bc2489a1-ab7e-4f84-87f2-e269c3543158 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:22 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Volume volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf (f36a0d49-2a15-4d64-9387-e20cd9d157cf): created successfully Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33827b0e-6cdd-4ebd-9ef3-c30b8b45215f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:22 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bc2489a1-ab7e-4f84-87f2-e269c3543158 Feb 27 02:11:22 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Flow 'volume_create_manager' (f7528ee3-732b-420b-a9b5-95867281466e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-quobyte-6011a921-6a58-4b36-9db3-bbacaf9a47ea-b620ac97-fea0-41cb-beb4-93859299e74e" acquired by "_create_volume_from_snapshot" :: waited 0.059s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Creating volume b620ac97-fea0-41cb-beb4-93859299e74e from snapshot 6011a921-6a58-4b36-9db3-bbacaf9a47ea {{(pid=82683) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "cinder-quobyte-b620ac97-fea0-41cb-beb4-93859299e74e" by "_copy_volume_from_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:22 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-27cee3b9-fdc7-4a40-ac41-b7fe1ec03423 tempest-SnapshotDependencyTests-1454701389 None] Created volume successfully. Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-quobyte-b620ac97-fea0-41cb-beb4-93859299e74e" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] snapshot: 6011a921-6a58-4b36-9db3-bbacaf9a47ea, volume: b620ac97-fea0-41cb-beb4-93859299e74e, {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5da34ce-1b49-41a1-92e4-76ba0b0c6f81]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:22 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea Feb 27 02:11:22 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:22 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3d958df5-eea1-46eb-9d81-3e2073b12f3c tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-bc2489a1-ab7e-4f84-87f2-e269c3543158" returned: 0 in 0.569s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3d958df5-eea1-46eb-9d81-3e2073b12f3c tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-quobyte-bc2489a1-ab7e-4f84-87f2-e269c3543158" released by "delete_volume" :: held 1.152s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d64e9c1d-d0a8-4e6e-8c32-c9d346c5a3c6 tempest-SnapshotDependencyTests-1454701389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-3d958df5-eea1-46eb-9d81-3e2073b12f3c tempest-CreateVolumesFromSnapshotTest-2102620973 None] Created reservations ['98f4df26-807d-4d84-9c83-75dd236a809c', 'e76a3081-d267-4ed7-a04a-d107fd6125bb', 'cc3d0409-cfad-482d-82ee-3e546fb40041', '8d13b7e6-45fd-455e-90e2-55e2f89445bb'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3d958df5-eea1-46eb-9d81-3e2073b12f3c tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3d958df5-eea1-46eb-9d81-3e2073b12f3c tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-3d958df5-eea1-46eb-9d81-3e2073b12f3c tempest-CreateVolumesFromSnapshotTest-2102620973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-3d958df5-eea1-46eb-9d81-3e2073b12f3c tempest-CreateVolumesFromSnapshotTest-2102620973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-3d958df5-eea1-46eb-9d81-3e2073b12f3c tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3d958df5-eea1-46eb-9d81-3e2073b12f3c tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:22 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:22 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:11:22 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea" returned: 0 in 0.684s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f635c7f7-5583-4589-9fde-b8cc9084c394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] will copy from snapshot at /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394 {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Creating direct copy from snapshot {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[257cc014-9eb6-43a6-b2aa-b0321cc3aac0]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:22 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:23 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394 Feb 27 02:11:23 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:23 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-3d958df5-eea1-46eb-9d81-3e2073b12f3c tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.461s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:23 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-3d958df5-eea1-46eb-9d81-3e2073b12f3c tempest-CreateVolumesFromSnapshotTest-2102620973 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:23 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-3d958df5-eea1-46eb-9d81-3e2073b12f3c tempest-CreateVolumesFromSnapshotTest-2102620973 None] Deleted volume successfully. Feb 27 02:11:23 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-3d958df5-eea1-46eb-9d81-3e2073b12f3c tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-bc2489a1-ab7e-4f84-87f2-e269c3543158-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:23 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394" returned: 0 in 0.585s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:23 devstack cinder-volume[82683]: DEBUG cinder.utils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Path /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b620ac97-fea0-41cb-beb4-93859299e74e not found in is_blk_device check {{(pid=82683) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:11:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b620ac97-fea0-41cb-beb4-93859299e74e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:23 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b620ac97-fea0-41cb-beb4-93859299e74e Feb 27 02:11:23 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:23 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ef029883-b271-4662-8e47-84913e219f73 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "cinder-a3be84e0-db7e-4430-b7f5-9b2900d37a24-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:23 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ef029883-b271-4662-8e47-84913e219f73 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-a3be84e0-db7e-4430-b7f5-9b2900d37a24-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:23 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ef029883-b271-4662-8e47-84913e219f73 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "cinder-quobyte-a3be84e0-db7e-4430-b7f5-9b2900d37a24" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:23 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ef029883-b271-4662-8e47-84913e219f73 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-quobyte-a3be84e0-db7e-4430-b7f5-9b2900d37a24" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:23 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[991c5d45-b6d3-46c9-af3c-c59dd93e0871]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:23 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ef029883-b271-4662-8e47-84913e219f73 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a3be84e0-db7e-4430-b7f5-9b2900d37a24 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:23 devstack sudo[90418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a3be84e0-db7e-4430-b7f5-9b2900d37a24 Feb 27 02:11:23 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:24 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ef029883-b271-4662-8e47-84913e219f73 tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a3be84e0-db7e-4430-b7f5-9b2900d37a24" returned: 0 in 0.973s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:24 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ef029883-b271-4662-8e47-84913e219f73 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a3be84e0-db7e-4430-b7f5-9b2900d37a24 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:24 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a3be84e0-db7e-4430-b7f5-9b2900d37a24 Feb 27 02:11:24 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:25 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:25 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ef029883-b271-4662-8e47-84913e219f73 tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a3be84e0-db7e-4430-b7f5-9b2900d37a24" returned: 0 in 1.128s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:25 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ef029883-b271-4662-8e47-84913e219f73 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-quobyte-a3be84e0-db7e-4430-b7f5-9b2900d37a24" released by "delete_volume" :: held 2.131s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:25 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-ef029883-b271-4662-8e47-84913e219f73 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Created reservations ['87812766-bfe5-430c-bd03-93f2f74a9a35', '45202084-43b3-4e3a-9162-4d6f18481073', 'f15d9eda-e507-46de-801c-7263f84a4965', '716468c8-9a0d-43a0-817f-c8f896c88f15'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ef029883-b271-4662-8e47-84913e219f73 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ef029883-b271-4662-8e47-84913e219f73 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ef029883-b271-4662-8e47-84913e219f73 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ef029883-b271-4662-8e47-84913e219f73 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ef029883-b271-4662-8e47-84913e219f73 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ef029883-b271-4662-8e47-84913e219f73 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:26 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:11:26 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:26 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b620ac97-fea0-41cb-beb4-93859299e74e" returned: 0 in 2.529s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9c7c650e-69dc-4064-8434-508ef86dcb8a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "cinder-a183139b-5f5c-45e3-966e-5674afbf2c22-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3fc8f6-4107-4c11-888e-a50ad498770c]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9c7c650e-69dc-4064-8434-508ef86dcb8a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-a183139b-5f5c-45e3-966e-5674afbf2c22-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9c7c650e-69dc-4064-8434-508ef86dcb8a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "cinder-quobyte-a183139b-5f5c-45e3-966e-5674afbf2c22" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9c7c650e-69dc-4064-8434-508ef86dcb8a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-quobyte-a183139b-5f5c-45e3-966e-5674afbf2c22" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c67f51-278b-4531-8c51-fb93d099aee6]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9c7c650e-69dc-4064-8434-508ef86dcb8a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a183139b-5f5c-45e3-966e-5674afbf2c22 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:26 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394 Feb 27 02:11:26 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:26 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a183139b-5f5c-45e3-966e-5674afbf2c22 Feb 27 02:11:26 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:26 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ef029883-b271-4662-8e47-84913e219f73 tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.437s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-ef029883-b271-4662-8e47-84913e219f73 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:26 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-ef029883-b271-4662-8e47-84913e219f73 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Deleted volume successfully. Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ef029883-b271-4662-8e47-84913e219f73 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-a3be84e0-db7e-4430-b7f5-9b2900d37a24-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:26 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394" returned: 0 in 0.651s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Image conversion details: src /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394, size 1024.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b620ac97-fea0-41cb-beb4-93859299e74e {{(pid=82683) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:11:26 devstack cinder-volume[82683]: INFO cinder.image.image_utils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Converted 1024.00 MB image at 404.62 MB/s Feb 27 02:11:26 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b620ac97-fea0-41cb-beb4-93859299e74e is being set with open permissions: ugo+rw Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b620ac97-fea0-41cb-beb4-93859299e74e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:26 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b620ac97-fea0-41cb-beb4-93859299e74e Feb 27 02:11:26 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:26 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9c7c650e-69dc-4064-8434-508ef86dcb8a tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a183139b-5f5c-45e3-966e-5674afbf2c22" returned: 0 in 0.618s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:26 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9c7c650e-69dc-4064-8434-508ef86dcb8a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a183139b-5f5c-45e3-966e-5674afbf2c22 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:26 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a183139b-5f5c-45e3-966e-5674afbf2c22 Feb 27 02:11:26 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:27 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b620ac97-fea0-41cb-beb4-93859299e74e" returned: 0 in 0.457s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-quobyte-b620ac97-fea0-41cb-beb4-93859299e74e" released by "_copy_volume_from_snapshot" :: held 4.995s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-quobyte-6011a921-6a58-4b36-9db3-bbacaf9a47ea-b620ac97-fea0-41cb-beb4-93859299e74e" released by "_create_volume_from_snapshot" :: held 5.023s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.085s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.851s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d912065-cfb4-4008-8f65-0822b62cd837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1585d832707496f892634b86981e189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:20Z,use_quota=True,user_id='2750359a04a04e9c93b3f90124038ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Creating volume 0d912065-cfb4-4008-8f65-0822b62cd837 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:27 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0d912065-cfb4-4008-8f65-0822b62cd837 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:27 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0d912065-cfb4-4008-8f65-0822b62cd837 1073741824 Feb 27 02:11:27 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:27 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c5d4f37-2a9a-4807-abe6-b7420f86345d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b620ac97-fea0-41cb-beb4-93859299e74e', 'volume_size': 1, 'snapshot_id': '6011a921-6a58-4b36-9db3-bbacaf9a47ea'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cbcf84b-5038-4a9e-b23f-4e3799edecab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9c7c650e-69dc-4064-8434-508ef86dcb8a tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-a183139b-5f5c-45e3-966e-5674afbf2c22" returned: 0 in 0.486s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:27 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Volume volume-b620ac97-fea0-41cb-beb4-93859299e74e (b620ac97-fea0-41cb-beb4-93859299e74e): created successfully Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cbcf84b-5038-4a9e-b23f-4e3799edecab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Flow 'volume_create_manager' (1e314a5b-6543-44f6-b01a-c7ae7e00a4a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9c7c650e-69dc-4064-8434-508ef86dcb8a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-quobyte-a183139b-5f5c-45e3-966e-5674afbf2c22" released by "delete_volume" :: held 1.143s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:27 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-83565cce-d8e4-4f8f-9bcd-44a0690660bd tempest-VolumeDependencyTests-1785253996 None] Created volume successfully. Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-9c7c650e-69dc-4064-8434-508ef86dcb8a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Created reservations ['67bca138-70f5-42fc-a1c7-e275ebb3d1b6', '07fa34a9-20fe-4d1b-9684-ec0ff6f1a44f', '2b5772e2-756a-4b0e-800a-51b55181a0e8', '60a3b618-9c9a-4dd7-945d-da2a739e0858'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9c7c650e-69dc-4064-8434-508ef86dcb8a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9c7c650e-69dc-4064-8434-508ef86dcb8a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-9c7c650e-69dc-4064-8434-508ef86dcb8a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-9c7c650e-69dc-4064-8434-508ef86dcb8a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-9c7c650e-69dc-4064-8434-508ef86dcb8a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9c7c650e-69dc-4064-8434-508ef86dcb8a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "cinder-6011a921-6a58-4b36-9db3-bbacaf9a47ea-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:27 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:11:27 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-6011a921-6a58-4b36-9db3-bbacaf9a47ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "cinder-quobyte-f635c7f7-5583-4589-9fde-b8cc9084c394" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-quobyte-f635c7f7-5583-4589-9fde-b8cc9084c394" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "cinder-quobyte-6011a921-6a58-4b36-9db3-bbacaf9a47ea" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-quobyte-6011a921-6a58-4b36-9db3-bbacaf9a47ea" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] Deleting offline snapshot 6011a921-6a58-4b36-9db3-bbacaf9a47ea of volume f635c7f7-5583-4589-9fde-b8cc9084c394 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] snapshot_file for this snap is: volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f475ed-6839-4506-8a9d-51250be2d84d]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:27 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea Feb 27 02:11:27 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:27 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0d912065-cfb4-4008-8f65-0822b62cd837 1073741824" returned: 0 in 0.642s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:27 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0d912065-cfb4-4008-8f65-0822b62cd837 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-9c7c650e-69dc-4064-8434-508ef86dcb8a tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.504s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-9c7c650e-69dc-4064-8434-508ef86dcb8a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:27 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0d912065-cfb4-4008-8f65-0822b62cd837 Feb 27 02:11:27 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:27 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-9c7c650e-69dc-4064-8434-508ef86dcb8a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Deleted volume successfully. Feb 27 02:11:27 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-9c7c650e-69dc-4064-8434-508ef86dcb8a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-a183139b-5f5c-45e3-966e-5674afbf2c22-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:28 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea" returned: 0 in 0.558s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f635c7f7-5583-4589-9fde-b8cc9084c394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[191b6e2e-2685-4e04-8166-1fbc480bbc60]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:28 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394 Feb 27 02:11:28 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-416b41f9-8c98-4b83-b008-0cb92301a57a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "cinder-ac93c34f-75a1-4054-9f11-86e292393fa9-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-416b41f9-8c98-4b83-b008-0cb92301a57a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-ac93c34f-75a1-4054-9f11-86e292393fa9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-416b41f9-8c98-4b83-b008-0cb92301a57a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "cinder-quobyte-ac93c34f-75a1-4054-9f11-86e292393fa9" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-416b41f9-8c98-4b83-b008-0cb92301a57a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-quobyte-ac93c34f-75a1-4054-9f11-86e292393fa9" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c58f1f-9d6c-4a9d-972a-c240e12de6b4]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-416b41f9-8c98-4b83-b008-0cb92301a57a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ac93c34f-75a1-4054-9f11-86e292393fa9 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:28 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0d912065-cfb4-4008-8f65-0822b62cd837" returned: 0 in 0.475s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d64e9c1d-d0a8-4e6e-8c32-c9d346c5a3c6 tempest-SnapshotDependencyTests-1454701389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.635s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd32fdf-36b2-46e2-9b80-2931a615d817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d912065-cfb4-4008-8f65-0822b62cd837', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369ff891-2a1d-4a28-b1bf-a43bce74cbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-d64e9c1d-d0a8-4e6e-8c32-c9d346c5a3c6 tempest-SnapshotDependencyTests-1454701389 None] Creating offline snapshot 1a1044e7-09aa-4d48-b26c-7b743db96efd of volume f36a0d49-2a15-4d64-9387-e20cd9d157cf {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:11:28 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Volume volume-0d912065-cfb4-4008-8f65-0822b62cd837 (0d912065-cfb4-4008-8f65-0822b62cd837): created successfully Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369ff891-2a1d-4a28-b1bf-a43bce74cbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:28 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ac93c34f-75a1-4054-9f11-86e292393fa9 Feb 27 02:11:28 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Flow 'volume_create_manager' (70a41287-c093-44ac-8a3a-570e6c7819a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b14749-9756-4d51-b6db-664ed9e3389e]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d64e9c1d-d0a8-4e6e-8c32-c9d346c5a3c6 tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:28 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-8b3a713f-54ba-43ce-89e5-39b85cc202e5 tempest-CinderUnicodeTest-455412751 None] Created volume successfully. Feb 27 02:11:28 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf Feb 27 02:11:28 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:28 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394" returned: 0 in 0.530s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:28 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea Feb 27 02:11:28 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:28 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-416b41f9-8c98-4b83-b008-0cb92301a57a tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ac93c34f-75a1-4054-9f11-86e292393fa9" returned: 0 in 0.521s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-416b41f9-8c98-4b83-b008-0cb92301a57a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ac93c34f-75a1-4054-9f11-86e292393fa9 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:28 devstack sudo[90490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ac93c34f-75a1-4054-9f11-86e292393fa9 Feb 27 02:11:28 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:28 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d64e9c1d-d0a8-4e6e-8c32-c9d346c5a3c6 tempest-SnapshotDependencyTests-1454701389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf" returned: 0 in 0.537s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:28 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d64e9c1d-d0a8-4e6e-8c32-c9d346c5a3c6 tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:28 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd 1G Feb 27 02:11:28 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:29 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea" returned: 0 in 0.635s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:29 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea Feb 27 02:11:29 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Flow 'volume_create_manager' (64f24a95-475e-4fa0-82e2-1265ad31fbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2596fac1-f550-4470-979e-3bca85bb8f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2596fac1-f550-4470-979e-3bca85bb8f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1734481248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f4540f-548d-47ba-95f8-0797d2cfe5ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1585d832707496f892634b86981e189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:29Z,use_quota=True,user_id='2750359a04a04e9c93b3f90124038ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e653ab-f3f8-44d6-b46c-df1d9b3419d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e653ab-f3f8-44d6-b46c-df1d9b3419d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa19de26-c013-465a-bf74-f9616bb4fa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa19de26-c013-465a-bf74-f9616bb4fa57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01f4540f-548d-47ba-95f8-0797d2cfe5ae', 'volume_name': 'volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa30fe66-139b-44f0-ad77-bb6db8f579b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa30fe66-139b-44f0-ad77-bb6db8f579b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c0eaa12-d4b3-4d44-b636-3edd8423b0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:29 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Volume 01f4540f-548d-47ba-95f8-0797d2cfe5ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae', 'volume_size': 1} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:29 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-416b41f9-8c98-4b83-b008-0cb92301a57a tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-ac93c34f-75a1-4054-9f11-86e292393fa9" returned: 0 in 0.648s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-416b41f9-8c98-4b83-b008-0cb92301a57a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-quobyte-ac93c34f-75a1-4054-9f11-86e292393fa9" released by "delete_volume" :: held 1.198s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-416b41f9-8c98-4b83-b008-0cb92301a57a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Created reservations ['ff306052-d288-4ad5-b545-359a3b940ea5', 'fbfd0bb3-a246-4290-8b91-7c1dae3cfd00', 'bfb2df80-cb2b-4cd9-82d8-2fa32cf9a9ad', '86100243-b4aa-48f6-ae75-58f1693d2c63'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:29 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d64e9c1d-d0a8-4e6e-8c32-c9d346c5a3c6 tempest-SnapshotDependencyTests-1454701389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd 1G" returned: 0 in 0.664s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d64e9c1d-d0a8-4e6e-8c32-c9d346c5a3c6 tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-416b41f9-8c98-4b83-b008-0cb92301a57a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-416b41f9-8c98-4b83-b008-0cb92301a57a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-416b41f9-8c98-4b83-b008-0cb92301a57a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:29 devstack sudo[90505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd Feb 27 02:11:29 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-416b41f9-8c98-4b83-b008-0cb92301a57a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-416b41f9-8c98-4b83-b008-0cb92301a57a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-416b41f9-8c98-4b83-b008-0cb92301a57a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:29 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:11:29 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:29 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394.6011a921-6a58-4b36-9db3-bbacaf9a47ea" returned: 0 in 0.500s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-quobyte-6011a921-6a58-4b36-9db3-bbacaf9a47ea" released by "_delete_snapshot" :: held 2.296s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-quobyte-f635c7f7-5583-4589-9fde-b8cc9084c394" released by "delete_snapshot" :: held 2.311s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] Created reservations ['0e2b98e0-8770-406f-8972-5e6380362d8a', 'd2f54ca8-f491-4031-b473-b90acac08a8f', 'dd3fa0ec-d8c4-4f3f-adb3-de312547bbae', '9027f470-c76e-4989-b9ce-b845ffb915bf'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:29 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] Delete snapshot completed successfully. Feb 27 02:11:29 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e21346f8-231b-4873-9c0d-73ffc40dbf91 tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-6011a921-6a58-4b36-9db3-bbacaf9a47ea-delete_snapshot" released by "delete_snapshot" :: held 2.431s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:30 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-416b41f9-8c98-4b83-b008-0cb92301a57a tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.470s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:30 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-416b41f9-8c98-4b83-b008-0cb92301a57a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:30 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-416b41f9-8c98-4b83-b008-0cb92301a57a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Deleted volume successfully. Feb 27 02:11:30 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d64e9c1d-d0a8-4e6e-8c32-c9d346c5a3c6 tempest-SnapshotDependencyTests-1454701389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd" returned: 0 in 0.521s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:30 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-d64e9c1d-d0a8-4e6e-8c32-c9d346c5a3c6 tempest-SnapshotDependencyTests-1454701389 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd is being set with open permissions: ugo+rw Feb 27 02:11:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d64e9c1d-d0a8-4e6e-8c32-c9d346c5a3c6 tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:30 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-416b41f9-8c98-4b83-b008-0cb92301a57a tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-ac93c34f-75a1-4054-9f11-86e292393fa9-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:30 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd Feb 27 02:11:30 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:30 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4b6b8016-6dcb-407f-9cb4-7c19f4772ce2 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "cinder-d30cd3dd-7c7f-443e-a577-5430cc612df5-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:30 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4b6b8016-6dcb-407f-9cb4-7c19f4772ce2 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-d30cd3dd-7c7f-443e-a577-5430cc612df5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:30 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4b6b8016-6dcb-407f-9cb4-7c19f4772ce2 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "cinder-quobyte-d30cd3dd-7c7f-443e-a577-5430cc612df5" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:30 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4b6b8016-6dcb-407f-9cb4-7c19f4772ce2 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-quobyte-d30cd3dd-7c7f-443e-a577-5430cc612df5" acquired by "delete_volume" :: waited 0.020s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:30 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1c0ba8-e2ef-4ac9-8536-06664e6c6c43]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b6b8016-6dcb-407f-9cb4-7c19f4772ce2 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d30cd3dd-7c7f-443e-a577-5430cc612df5 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:30 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a4fd888d-ad51-46c1-9696-119770448958 tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "cinder-f635c7f7-5583-4589-9fde-b8cc9084c394-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:30 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:30 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a4fd888d-ad51-46c1-9696-119770448958 tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-f635c7f7-5583-4589-9fde-b8cc9084c394-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d64e9c1d-d0a8-4e6e-8c32-c9d346c5a3c6 tempest-SnapshotDependencyTests-1454701389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd" returned: 0 in 0.481s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:30 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d30cd3dd-7c7f-443e-a577-5430cc612df5 Feb 27 02:11:30 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:30 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a4fd888d-ad51-46c1-9696-119770448958 tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "cinder-quobyte-f635c7f7-5583-4589-9fde-b8cc9084c394" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d64e9c1d-d0a8-4e6e-8c32-c9d346c5a3c6 tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:30 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a4fd888d-ad51-46c1-9696-119770448958 tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-quobyte-f635c7f7-5583-4589-9fde-b8cc9084c394" acquired by "delete_volume" :: waited 0.022s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:30 devstack sudo[90518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.info Feb 27 02:11:30 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:30 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c1eb81-eb80-4d9c-9a17-c76bc65d6bce]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:30 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a4fd888d-ad51-46c1-9696-119770448958 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:30 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394 Feb 27 02:11:30 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:31 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d64e9c1d-d0a8-4e6e-8c32-c9d346c5a3c6 tempest-SnapshotDependencyTests-1454701389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.info" returned: 0 in 0.391s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:31 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-d64e9c1d-d0a8-4e6e-8c32-c9d346c5a3c6 tempest-SnapshotDependencyTests-1454701389 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.info is being set with open permissions: ugo+rw Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d64e9c1d-d0a8-4e6e-8c32-c9d346c5a3c6 tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:31 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b6b8016-6dcb-407f-9cb4-7c19f4772ce2 tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d30cd3dd-7c7f-443e-a577-5430cc612df5" returned: 0 in 0.533s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b6b8016-6dcb-407f-9cb4-7c19f4772ce2 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d30cd3dd-7c7f-443e-a577-5430cc612df5 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:31 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.info Feb 27 02:11:31 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:31 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d30cd3dd-7c7f-443e-a577-5430cc612df5 Feb 27 02:11:31 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:31 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a4fd888d-ad51-46c1-9696-119770448958 tempest-VolumeDependencyTests-1785253996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394" returned: 0 in 0.555s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a4fd888d-ad51-46c1-9696-119770448958 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:31 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394 Feb 27 02:11:31 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:31 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d64e9c1d-d0a8-4e6e-8c32-c9d346c5a3c6 tempest-SnapshotDependencyTests-1454701389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.info" returned: 0 in 0.403s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d64e9c1d-d0a8-4e6e-8c32-c9d346c5a3c6 tempest-SnapshotDependencyTests-1454701389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.114s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.083s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1734481248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01f4540f-548d-47ba-95f8-0797d2cfe5ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1585d832707496f892634b86981e189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:29Z,use_quota=True,user_id='2750359a04a04e9c93b3f90124038ac4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Creating volume 01f4540f-548d-47ba-95f8-0797d2cfe5ae {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:31 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:31 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae 1073741824 Feb 27 02:11:31 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:31 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-d64e9c1d-d0a8-4e6e-8c32-c9d346c5a3c6 tempest-SnapshotDependencyTests-1454701389 None] Create snapshot completed successfully Feb 27 02:11:31 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b6b8016-6dcb-407f-9cb4-7c19f4772ce2 tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d30cd3dd-7c7f-443e-a577-5430cc612df5" returned: 0 in 0.461s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4b6b8016-6dcb-407f-9cb4-7c19f4772ce2 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-quobyte-d30cd3dd-7c7f-443e-a577-5430cc612df5" released by "delete_volume" :: held 1.023s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-4b6b8016-6dcb-407f-9cb4-7c19f4772ce2 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Created reservations ['c759fcf1-f280-4fb7-9852-fb3c0d3c7a4b', '70178852-7116-4b98-9b6a-68d00ed59270', 'a54441a5-621c-4756-8804-738acfd5a581', 'dd14213e-df4c-4ebb-8f0f-3bcaa124b4e0'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4b6b8016-6dcb-407f-9cb4-7c19f4772ce2 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4b6b8016-6dcb-407f-9cb4-7c19f4772ce2 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4b6b8016-6dcb-407f-9cb4-7c19f4772ce2 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4b6b8016-6dcb-407f-9cb4-7c19f4772ce2 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4b6b8016-6dcb-407f-9cb4-7c19f4772ce2 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b6b8016-6dcb-407f-9cb4-7c19f4772ce2 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:31 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:11:31 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:31 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a4fd888d-ad51-46c1-9696-119770448958 tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f635c7f7-5583-4589-9fde-b8cc9084c394" returned: 0 in 0.480s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a4fd888d-ad51-46c1-9696-119770448958 tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-quobyte-f635c7f7-5583-4589-9fde-b8cc9084c394" released by "delete_volume" :: held 1.068s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-a4fd888d-ad51-46c1-9696-119770448958 tempest-VolumeDependencyTests-1785253996 None] Created reservations ['4ab9ab7b-39cd-4753-b5c4-611c25212371', '15312a7c-792b-4287-bdae-9debdd156cfe', 'a7bda1ad-c7ed-4fab-9ffa-aaa8cc4f8957', '8b3a09cc-41ec-4d8f-8c49-03e7bc776a71'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a4fd888d-ad51-46c1-9696-119770448958 tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a4fd888d-ad51-46c1-9696-119770448958 tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a4fd888d-ad51-46c1-9696-119770448958 tempest-VolumeDependencyTests-1785253996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-a4fd888d-ad51-46c1-9696-119770448958 tempest-VolumeDependencyTests-1785253996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-a4fd888d-ad51-46c1-9696-119770448958 tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:31 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a4fd888d-ad51-46c1-9696-119770448958 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:31 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:11:31 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:32 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae 1073741824" returned: 0 in 0.521s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:32 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4b6b8016-6dcb-407f-9cb4-7c19f4772ce2 tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.427s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-4b6b8016-6dcb-407f-9cb4-7c19f4772ce2 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:32 devstack sudo[90548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae Feb 27 02:11:32 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:32 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-4b6b8016-6dcb-407f-9cb4-7c19f4772ce2 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Deleted volume successfully. Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-4b6b8016-6dcb-407f-9cb4-7c19f4772ce2 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-d30cd3dd-7c7f-443e-a577-5430cc612df5-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:32 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-a4fd888d-ad51-46c1-9696-119770448958 tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.465s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-a4fd888d-ad51-46c1-9696-119770448958 tempest-VolumeDependencyTests-1785253996 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:32 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-a4fd888d-ad51-46c1-9696-119770448958 tempest-VolumeDependencyTests-1785253996 None] Deleted volume successfully. Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-a4fd888d-ad51-46c1-9696-119770448958 tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-f635c7f7-5583-4589-9fde-b8cc9084c394-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:32 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae" returned: 0 in 0.467s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c0eaa12-d4b3-4d44-b636-3edd8423b0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ade21b3-acbe-4c11-adfd-59c0b6f11856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Flow 'volume_create_manager' (bb027b53-4230-41e3-94cd-3eeb2ff7e794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf6b604-eba0-4cde-85ac-eedd7da0ff3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf6b604-eba0-4cde-85ac-eedd7da0ff3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c0cdb2-9803-4828-99cc-64b028591fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1852f65ec35446cbb33f9a1ba1e08078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1a1044e7-09aa-4d48-b26c-7b743db96efd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:32Z,use_quota=True,user_id='dbf3238bf65449f28ba319f97e2972e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b69440af-63c9-41ba-be6d-315b5a59d4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b69440af-63c9-41ba-be6d-315b5a59d4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3494b96-2040-4fc0-91f8-a1cc725c0eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3494b96-2040-4fc0-91f8-a1cc725c0eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e6c0cdb2-9803-4828-99cc-64b028591fff', 'volume_name': 'volume-e6c0cdb2-9803-4828-99cc-64b028591fff', 'volume_size': 1, 'snapshot_id': '1a1044e7-09aa-4d48-b26c-7b743db96efd'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe2ad71d-d343-49d9-aaaf-29ad8eefd6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe2ad71d-d343-49d9-aaaf-29ad8eefd6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (526c390e-ca07-4c85-8810-3157f2f203e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:32 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Volume e6c0cdb2-9803-4828-99cc-64b028591fff: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e6c0cdb2-9803-4828-99cc-64b028591fff', 'volume_size': 1, 'snapshot_id': '1a1044e7-09aa-4d48-b26c-7b743db96efd'} Feb 27 02:11:32 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Volume volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae (01f4540f-548d-47ba-95f8-0797d2cfe5ae): created successfully Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ade21b3-acbe-4c11-adfd-59c0b6f11856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Flow 'volume_create_manager' (64f24a95-475e-4fa0-82e2-1265ad31fbd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Acquiring lock "cinder-quobyte-1a1044e7-09aa-4d48-b26c-7b743db96efd-e6c0cdb2-9803-4828-99cc-64b028591fff" by "_create_volume_from_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:32 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-f03e20f2-3d8b-43ab-83b2-b7f9433d1f39 tempest-CinderUnicodeTest-455412751 None] Created volume successfully. Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Lock "cinder-quobyte-1a1044e7-09aa-4d48-b26c-7b743db96efd-e6c0cdb2-9803-4828-99cc-64b028591fff" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Creating volume e6c0cdb2-9803-4828-99cc-64b028591fff from snapshot 1a1044e7-09aa-4d48-b26c-7b743db96efd {{(pid=82683) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Acquiring lock "cinder-quobyte-e6c0cdb2-9803-4828-99cc-64b028591fff" by "_copy_volume_from_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Lock "cinder-quobyte-e6c0cdb2-9803-4828-99cc-64b028591fff" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] snapshot: 1a1044e7-09aa-4d48-b26c-7b743db96efd, volume: e6c0cdb2-9803-4828-99cc-64b028591fff, {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "cinder-dcc6a61d-7401-48af-8dc0-edfdbec854ca-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b44688-c47f-4cf9-b802-8f85187df7bb]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-dcc6a61d-7401-48af-8dc0-edfdbec854ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "cinder-quobyte-78c109c5-c68e-4c84-88a7-6a742ff1850b" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-quobyte-78c109c5-c68e-4c84-88a7-6a742ff1850b" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "cinder-quobyte-dcc6a61d-7401-48af-8dc0-edfdbec854ca" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-quobyte-dcc6a61d-7401-48af-8dc0-edfdbec854ca" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] Deleting offline snapshot dcc6a61d-7401-48af-8dc0-edfdbec854ca of volume 78c109c5-c68e-4c84-88a7-6a742ff1850b {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] snapshot_file for this snap is: volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.dcc6a61d-7401-48af-8dc0-edfdbec854ca {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1188397-6757-42ba-9ab4-b91ab07d6d70]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:32 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.dcc6a61d-7401-48af-8dc0-edfdbec854ca {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:32 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd Feb 27 02:11:32 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:32 devstack sudo[90553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.dcc6a61d-7401-48af-8dc0-edfdbec854ca Feb 27 02:11:32 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Flow 'volume_create_manager' (40091258-01cc-4a36-8324-351ae6e6efbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11f68bb-b206-4780-a774-16d890be3e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11f68bb-b206-4780-a774-16d890be3e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1269387687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c742f3-d3d7-42ed-b16c-db42bffabdf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7d2fa25f108464186dff1d0ddbef924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:33Z,use_quota=True,user_id='2feadb56e3ba4673beff8c3457738d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3585bf7a-8b9f-4e31-b8ef-428f3aaedd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3585bf7a-8b9f-4e31-b8ef-428f3aaedd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a1507d-7c84-4348-a369-79d888ec2666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a1507d-7c84-4348-a369-79d888ec2666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3c742f3-d3d7-42ed-b16c-db42bffabdf6', 'volume_name': 'volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b180257-a3c1-4a71-802e-fbfa1abec634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b180257-a3c1-4a71-802e-fbfa1abec634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d244cbb-6926-4d03-b70b-41c25a79b727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:33 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Volume b3c742f3-d3d7-42ed-b16c-db42bffabdf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6', 'volume_size': 1} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:33 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd" returned: 0 in 0.546s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] will copy from snapshot at /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Creating direct copy from snapshot {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10ae2b5-b2c2-4390-9d9c-5f704010f564]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:33 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf Feb 27 02:11:33 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:33 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.dcc6a61d-7401-48af-8dc0-edfdbec854ca" returned: 0 in 0.563s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78c109c5-c68e-4c84-88a7-6a742ff1850b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[016726f9-3590-4140-bb54-9e98475a60e3]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:33 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b Feb 27 02:11:33 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-7b066a51-cae1-4ba3-9669-cbd53e3b014c tempest-CinderUnicodeTest-455412751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:33 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf" returned: 0 in 0.520s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG cinder.utils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Path /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e6c0cdb2-9803-4828-99cc-64b028591fff not found in is_blk_device check {{(pid=82683) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e6c0cdb2-9803-4828-99cc-64b028591fff {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:33 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e6c0cdb2-9803-4828-99cc-64b028591fff Feb 27 02:11:33 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:33 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b" returned: 0 in 0.539s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:33 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.dcc6a61d-7401-48af-8dc0-edfdbec854ca {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:33 devstack sudo[90574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.dcc6a61d-7401-48af-8dc0-edfdbec854ca Feb 27 02:11:33 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:34 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.dcc6a61d-7401-48af-8dc0-edfdbec854ca" returned: 0 in 0.695s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:34 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.dcc6a61d-7401-48af-8dc0-edfdbec854ca {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:34 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.dcc6a61d-7401-48af-8dc0-edfdbec854ca Feb 27 02:11:34 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:35 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:35 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b.dcc6a61d-7401-48af-8dc0-edfdbec854ca" returned: 0 in 1.206s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:35 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-quobyte-dcc6a61d-7401-48af-8dc0-edfdbec854ca" released by "_delete_snapshot" :: held 3.102s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:35 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-quobyte-78c109c5-c68e-4c84-88a7-6a742ff1850b" released by "delete_snapshot" :: held 3.127s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:35 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] Created reservations ['d8fcc84e-91f3-4655-9faf-4c3a38b3d63a', 'd0921b88-5643-4258-ace3-30f3b5c9cc87', '602c2575-bcf7-4b11-a0d7-618beb4a23a0', '6c0d9d19-69a3-4ef8-96cf-302a69f44343'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:36 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] Delete snapshot completed successfully. Feb 27 02:11:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-65af4c42-07f5-44fb-a4a9-1fbafa3628ad tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-dcc6a61d-7401-48af-8dc0-edfdbec854ca-delete_snapshot" released by "delete_snapshot" :: held 3.396s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:36 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e6c0cdb2-9803-4828-99cc-64b028591fff" returned: 0 in 2.401s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:36 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fc5dbf-ddd7-4c79-b713-09d730c2735b]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:36 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf Feb 27 02:11:36 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:36 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf" returned: 0 in 0.630s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:36 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Image conversion details: src /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf, size 1024.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e6c0cdb2-9803-4828-99cc-64b028591fff {{(pid=82683) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:11:36 devstack cinder-volume[82683]: INFO cinder.image.image_utils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Converted 1024.00 MB image at 426.29 MB/s Feb 27 02:11:36 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e6c0cdb2-9803-4828-99cc-64b028591fff is being set with open permissions: ugo+rw Feb 27 02:11:36 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e6c0cdb2-9803-4828-99cc-64b028591fff {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:36 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e6c0cdb2-9803-4828-99cc-64b028591fff Feb 27 02:11:36 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-40ea5e86-3081-4984-86d1-426916765c66 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "cinder-78c109c5-c68e-4c84-88a7-6a742ff1850b-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:36 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-40ea5e86-3081-4984-86d1-426916765c66 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-78c109c5-c68e-4c84-88a7-6a742ff1850b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-40ea5e86-3081-4984-86d1-426916765c66 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "cinder-quobyte-78c109c5-c68e-4c84-88a7-6a742ff1850b" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-40ea5e86-3081-4984-86d1-426916765c66 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-quobyte-78c109c5-c68e-4c84-88a7-6a742ff1850b" acquired by "delete_volume" :: waited 0.008s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c0f7cf-d3c0-47d8-957b-8e2cf0ea77db]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-40ea5e86-3081-4984-86d1-426916765c66 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:37 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b Feb 27 02:11:37 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:37 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e6c0cdb2-9803-4828-99cc-64b028591fff" returned: 0 in 0.441s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Lock "cinder-quobyte-e6c0cdb2-9803-4828-99cc-64b028591fff" released by "_copy_volume_from_snapshot" :: held 4.598s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Lock "cinder-quobyte-1a1044e7-09aa-4d48-b26c-7b743db96efd-e6c0cdb2-9803-4828-99cc-64b028591fff" released by "_create_volume_from_snapshot" :: held 4.615s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.628s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.127s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1269387687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3c742f3-d3d7-42ed-b16c-db42bffabdf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7d2fa25f108464186dff1d0ddbef924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:33Z,use_quota=True,user_id='2feadb56e3ba4673beff8c3457738d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Creating volume b3c742f3-d3d7-42ed-b16c-db42bffabdf6 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:37 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:37 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 1073741824 Feb 27 02:11:37 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (526c390e-ca07-4c85-8810-3157f2f203e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6c0cdb2-9803-4828-99cc-64b028591fff', 'volume_size': 1, 'snapshot_id': '1a1044e7-09aa-4d48-b26c-7b743db96efd'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618c2898-b920-409d-8489-fcc813f4a316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:37 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Volume volume-e6c0cdb2-9803-4828-99cc-64b028591fff (e6c0cdb2-9803-4828-99cc-64b028591fff): created successfully Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618c2898-b920-409d-8489-fcc813f4a316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Flow 'volume_create_manager' (bb027b53-4230-41e3-94cd-3eeb2ff7e794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:37 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-e40d5259-f650-464e-a076-6a5c33e827fe tempest-SnapshotDependencyTests-1454701389 None] Created volume successfully. Feb 27 02:11:37 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-40ea5e86-3081-4984-86d1-426916765c66 tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b" returned: 0 in 0.517s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-40ea5e86-3081-4984-86d1-426916765c66 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:37 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b Feb 27 02:11:37 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:37 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 1073741824" returned: 0 in 0.524s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:37 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 Feb 27 02:11:37 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] Acquiring lock "cinder-1a1044e7-09aa-4d48-b26c-7b743db96efd-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:37 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] Lock "cinder-1a1044e7-09aa-4d48-b26c-7b743db96efd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] Acquiring lock "cinder-quobyte-f36a0d49-2a15-4d64-9387-e20cd9d157cf" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] Lock "cinder-quobyte-f36a0d49-2a15-4d64-9387-e20cd9d157cf" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] Acquiring lock "cinder-quobyte-1a1044e7-09aa-4d48-b26c-7b743db96efd" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] Lock "cinder-quobyte-1a1044e7-09aa-4d48-b26c-7b743db96efd" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] Deleting offline snapshot 1a1044e7-09aa-4d48-b26c-7b743db96efd of volume f36a0d49-2a15-4d64-9387-e20cd9d157cf {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] snapshot_file for this snap is: volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f833c76-29d6-4ebb-841c-6a9786b9308b]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:38 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-40ea5e86-3081-4984-86d1-426916765c66 tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-78c109c5-c68e-4c84-88a7-6a742ff1850b" returned: 0 in 0.489s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-40ea5e86-3081-4984-86d1-426916765c66 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-quobyte-78c109c5-c68e-4c84-88a7-6a742ff1850b" released by "delete_volume" :: held 1.050s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-40ea5e86-3081-4984-86d1-426916765c66 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Created reservations ['754bf9d1-ee47-4629-b278-82ba86c4c9be', '3bdf6af4-7ca2-4672-a7df-94ea8ad3e1df', 'dfba6682-3430-4732-a7d8-596fa39c804d', '0705fe5a-cfcb-4c11-aba5-ad227ed49979'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:38 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd Feb 27 02:11:38 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-40ea5e86-3081-4984-86d1-426916765c66 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-40ea5e86-3081-4984-86d1-426916765c66 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-40ea5e86-3081-4984-86d1-426916765c66 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-40ea5e86-3081-4984-86d1-426916765c66 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-40ea5e86-3081-4984-86d1-426916765c66 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-40ea5e86-3081-4984-86d1-426916765c66 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:38 devstack sudo[90618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:11:38 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:38 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6" returned: 0 in 0.471s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-7b066a51-cae1-4ba3-9669-cbd53e3b014c tempest-CinderUnicodeTest-455412751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.601s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-7b066a51-cae1-4ba3-9669-cbd53e3b014c tempest-CinderUnicodeTest-455412751 None] Creating offline snapshot a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b of volume 01f4540f-548d-47ba-95f8-0797d2cfe5ae {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d244cbb-6926-4d03-b70b-41c25a79b727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c4f3cc-1fc5-4f8b-b3ce-aad8a33b978e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[818a8986-3169-480d-89cc-b82ed70a1abf]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-7b066a51-cae1-4ba3-9669-cbd53e3b014c tempest-CinderUnicodeTest-455412751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:38 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Volume volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 (b3c742f3-d3d7-42ed-b16c-db42bffabdf6): created successfully Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c4f3cc-1fc5-4f8b-b3ce-aad8a33b978e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Flow 'volume_create_manager' (40091258-01cc-4a36-8324-351ae6e6efbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:38 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-4cb8e70f-ec68-4ecf-9d36-dfc0bb85b247 tempest-VolumeDependencyTests-1785253996 None] Created volume successfully. Feb 27 02:11:38 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae Feb 27 02:11:38 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:38 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd" returned: 0 in 0.582s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[adef3981-396e-4598-9961-8f46e63952d0]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:38 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-40ea5e86-3081-4984-86d1-426916765c66 tempest-CreateVolumesFromSnapshotTest-2102620973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.494s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-40ea5e86-3081-4984-86d1-426916765c66 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:38 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-40ea5e86-3081-4984-86d1-426916765c66 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Deleted volume successfully. Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-40ea5e86-3081-4984-86d1-426916765c66 tempest-CreateVolumesFromSnapshotTest-2102620973 None] Lock "cinder-78c109c5-c68e-4c84-88a7-6a742ff1850b-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:38 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf Feb 27 02:11:38 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Flow 'volume_create_manager' (6b90860e-5786-4463-8ad7-1720e91f73f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e55988-99b7-4b3e-8a2d-87a06162bc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e55988-99b7-4b3e-8a2d-87a06162bc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1388565743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e11a93-bfaf-43f6-9f3f-00ce6154a54f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7d2fa25f108464186dff1d0ddbef924',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b3c742f3-d3d7-42ed-b16c-db42bffabdf6,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:39Z,use_quota=True,user_id='2feadb56e3ba4673beff8c3457738d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0ba507-b56e-436b-b1de-9997924573b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0ba507-b56e-436b-b1de-9997924573b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c8cc95-eee8-42de-a2ea-f3979a0129ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c8cc95-eee8-42de-a2ea-f3979a0129ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e1e11a93-bfaf-43f6-9f3f-00ce6154a54f', 'volume_name': 'volume-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f', 'volume_size': 1, 'source_volid': 'b3c742f3-d3d7-42ed-b16c-db42bffabdf6', 'source_volstatus': 'available'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (995ca761-95a5-4306-acf6-071cb10c3a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (995ca761-95a5-4306-acf6-071cb10c3a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434a7fd8-706e-4673-a573-5a923a90358a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:38 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Volume e1e11a93-bfaf-43f6-9f3f-00ce6154a54f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f', 'volume_size': 1, 'source_volid': 'b3c742f3-d3d7-42ed-b16c-db42bffabdf6', 'source_volstatus': 'available'} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:38 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-7b066a51-cae1-4ba3-9669-cbd53e3b014c tempest-CinderUnicodeTest-455412751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae" returned: 0 in 0.622s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:38 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-7b066a51-cae1-4ba3-9669-cbd53e3b014c tempest-CinderUnicodeTest-455412751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:38 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b 1G Feb 27 02:11:38 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:39 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf" returned: 0 in 0.669s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:39 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd Feb 27 02:11:39 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:39 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-7b066a51-cae1-4ba3-9669-cbd53e3b014c tempest-CinderUnicodeTest-455412751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b 1G" returned: 0 in 0.540s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-7b066a51-cae1-4ba3-9669-cbd53e3b014c tempest-CinderUnicodeTest-455412751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:39 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b Feb 27 02:11:39 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:39 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd" returned: 0 in 0.483s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:39 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:39 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd Feb 27 02:11:39 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:40 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-7b066a51-cae1-4ba3-9669-cbd53e3b014c tempest-CinderUnicodeTest-455412751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b" returned: 0 in 0.553s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:40 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-7b066a51-cae1-4ba3-9669-cbd53e3b014c tempest-CinderUnicodeTest-455412751 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b is being set with open permissions: ugo+rw Feb 27 02:11:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-7b066a51-cae1-4ba3-9669-cbd53e3b014c tempest-CinderUnicodeTest-455412751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:40 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b Feb 27 02:11:40 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:40 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf.1a1044e7-09aa-4d48-b26c-7b743db96efd" returned: 0 in 0.486s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:40 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] Lock "cinder-quobyte-1a1044e7-09aa-4d48-b26c-7b743db96efd" released by "_delete_snapshot" :: held 2.295s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:40 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] Lock "cinder-quobyte-f36a0d49-2a15-4d64-9387-e20cd9d157cf" released by "delete_snapshot" :: held 2.306s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:40 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] Created reservations ['e195c5cc-eb94-4fc0-8bf1-3d852ecc210d', '2d145529-f3db-43b2-9499-e713a72d97e1', '77d2a963-0dfa-4b1a-97b0-e72e4ab2c56e', 'd009a93e-f5cb-4fc1-8189-e1da84dd2f5f'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:40 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] Delete snapshot completed successfully. Feb 27 02:11:40 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-b6059630-1def-4fdf-a32c-b8f0b7dd60e4 tempest-SnapshotDependencyTests-1454701389 None] Lock "cinder-1a1044e7-09aa-4d48-b26c-7b743db96efd-delete_snapshot" released by "delete_snapshot" :: held 2.414s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:40 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-7b066a51-cae1-4ba3-9669-cbd53e3b014c tempest-CinderUnicodeTest-455412751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b" returned: 0 in 0.502s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:40 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-7b066a51-cae1-4ba3-9669-cbd53e3b014c tempest-CinderUnicodeTest-455412751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:40 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.info Feb 27 02:11:40 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Flow 'volume_create_manager' (8db1c7b1-bce5-4adb-8f09-239f544166ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624d16a6-501c-4b9f-8c87-21adc3c2f340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624d16a6-501c-4b9f-8c87-21adc3c2f340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-537211817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d691cbad-31f3-4c40-aaa9-8f760c9d2110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9ce3c7b7d74c038b0e612a6d19f242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:41Z,use_quota=True,user_id='ef7ef56d3d7b45f1ab7a044f54bd3774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf0f7bc-45fe-4355-a8f1-7516fba6d52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf0f7bc-45fe-4355-a8f1-7516fba6d52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7930ed86-cf64-4b33-ba7f-3c573a8dc434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7930ed86-cf64-4b33-ba7f-3c573a8dc434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd691cbad-31f3-4c40-aaa9-8f760c9d2110', 'volume_name': 'volume-d691cbad-31f3-4c40-aaa9-8f760c9d2110', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2996154f-231e-4712-9dd7-4f2f6d6de4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2996154f-231e-4712-9dd7-4f2f6d6de4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a11bbace-7776-4fee-a6c0-5cc29aed68c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:41 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Volume d691cbad-31f3-4c40-aaa9-8f760c9d2110: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d691cbad-31f3-4c40-aaa9-8f760c9d2110', 'volume_size': 1} Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:41 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-7b066a51-cae1-4ba3-9669-cbd53e3b014c tempest-CinderUnicodeTest-455412751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.info" returned: 0 in 0.553s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:41 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-7b066a51-cae1-4ba3-9669-cbd53e3b014c tempest-CinderUnicodeTest-455412751 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.info is being set with open permissions: ugo+rw Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-7b066a51-cae1-4ba3-9669-cbd53e3b014c tempest-CinderUnicodeTest-455412751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:41 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.info Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f5efc3f5-848b-4d37-8aca-16a7dc2b2664 tempest-SnapshotDependencyTests-1454701389 None] Acquiring lock "cinder-f36a0d49-2a15-4d64-9387-e20cd9d157cf-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:41 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f5efc3f5-848b-4d37-8aca-16a7dc2b2664 tempest-SnapshotDependencyTests-1454701389 None] Lock "cinder-f36a0d49-2a15-4d64-9387-e20cd9d157cf-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f5efc3f5-848b-4d37-8aca-16a7dc2b2664 tempest-SnapshotDependencyTests-1454701389 None] Acquiring lock "cinder-quobyte-f36a0d49-2a15-4d64-9387-e20cd9d157cf" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f5efc3f5-848b-4d37-8aca-16a7dc2b2664 tempest-SnapshotDependencyTests-1454701389 None] Lock "cinder-quobyte-f36a0d49-2a15-4d64-9387-e20cd9d157cf" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3e7385-5112-4c86-8dea-2dbe3d303d63]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f5efc3f5-848b-4d37-8aca-16a7dc2b2664 tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:41 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf Feb 27 02:11:41 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:41 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-7b066a51-cae1-4ba3-9669-cbd53e3b014c tempest-CinderUnicodeTest-455412751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.info" returned: 0 in 0.508s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-7b066a51-cae1-4ba3-9669-cbd53e3b014c tempest-CinderUnicodeTest-455412751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.351s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.730s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:41 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Cloning volume b3c742f3-d3d7-42ed-b16c-db42bffabdf6 to volume e1e11a93-bfaf-43f6-9f3f-00ce6154a54f Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Creating offline snapshot a874ad41-d670-4f16-a725-37a0cdca33de of volume b3c742f3-d3d7-42ed-b16c-db42bffabdf6 {{(pid=82683) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 27 02:11:41 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-7b066a51-cae1-4ba3-9669-cbd53e3b014c tempest-CinderUnicodeTest-455412751 None] Create snapshot completed successfully Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb95103-c568-4d00-9a49-74ab88a2c75b]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:41 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f5efc3f5-848b-4d37-8aca-16a7dc2b2664 tempest-SnapshotDependencyTests-1454701389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf" returned: 0 in 0.524s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:41 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f5efc3f5-848b-4d37-8aca-16a7dc2b2664 tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:41 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf Feb 27 02:11:41 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:41 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 Feb 27 02:11:41 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] Acquiring lock "cinder-a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b-delete_snapshot" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] Lock "cinder-a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] Acquiring lock "cinder-quobyte-01f4540f-548d-47ba-95f8-0797d2cfe5ae" by "delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] Lock "cinder-quobyte-01f4540f-548d-47ba-95f8-0797d2cfe5ae" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] Acquiring lock "cinder-quobyte-a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] Lock "cinder-quobyte-a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] Deleting offline snapshot a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b of volume 01f4540f-548d-47ba-95f8-0797d2cfe5ae {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] snapshot_file for this snap is: volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d7bf33-de22-4761-a996-9883742a4423]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:42 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b Feb 27 02:11:42 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:42 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f5efc3f5-848b-4d37-8aca-16a7dc2b2664 tempest-SnapshotDependencyTests-1454701389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-f36a0d49-2a15-4d64-9387-e20cd9d157cf" returned: 0 in 0.540s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f5efc3f5-848b-4d37-8aca-16a7dc2b2664 tempest-SnapshotDependencyTests-1454701389 None] Lock "cinder-quobyte-f36a0d49-2a15-4d64-9387-e20cd9d157cf" released by "delete_volume" :: held 1.102s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:42 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6" returned: 0 in 0.631s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de 1G {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:42 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de 1G Feb 27 02:11:42 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-f5efc3f5-848b-4d37-8aca-16a7dc2b2664 tempest-SnapshotDependencyTests-1454701389 None] Created reservations ['c209dce6-1783-499a-80c3-83bdadd5d7e5', '69529de1-a357-4ac8-a3d3-4d018bc26fea', 'ecd27dd6-d91d-4879-b1ee-2159b0c449bf', '1e448ef9-73eb-4498-aafa-cd1704b27e70'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f5efc3f5-848b-4d37-8aca-16a7dc2b2664 tempest-SnapshotDependencyTests-1454701389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f5efc3f5-848b-4d37-8aca-16a7dc2b2664 tempest-SnapshotDependencyTests-1454701389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f5efc3f5-848b-4d37-8aca-16a7dc2b2664 tempest-SnapshotDependencyTests-1454701389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f5efc3f5-848b-4d37-8aca-16a7dc2b2664 tempest-SnapshotDependencyTests-1454701389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f5efc3f5-848b-4d37-8aca-16a7dc2b2664 tempest-SnapshotDependencyTests-1454701389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f5efc3f5-848b-4d37-8aca-16a7dc2b2664 tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:42 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:11:42 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:42 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b" returned: 0 in 0.553s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[80aebf82-58da-498b-b87b-55b5d9a5f900]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:42 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae Feb 27 02:11:42 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:42 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de 1G" returned: 0 in 0.484s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:42 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de Feb 27 02:11:42 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:42 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f5efc3f5-848b-4d37-8aca-16a7dc2b2664 tempest-SnapshotDependencyTests-1454701389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.484s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-f5efc3f5-848b-4d37-8aca-16a7dc2b2664 tempest-SnapshotDependencyTests-1454701389 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:42 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-f5efc3f5-848b-4d37-8aca-16a7dc2b2664 tempest-SnapshotDependencyTests-1454701389 None] Deleted volume successfully. Feb 27 02:11:42 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f5efc3f5-848b-4d37-8aca-16a7dc2b2664 tempest-SnapshotDependencyTests-1454701389 None] Lock "cinder-f36a0d49-2a15-4d64-9387-e20cd9d157cf-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:43 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae" returned: 0 in 0.561s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:43 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b Feb 27 02:11:43 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:43 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1bf7efc1-0fe3-40c0-9eae-36d57f0dd139 tempest-SnapshotDependencyTests-1454701389 None] Acquiring lock "cinder-e6c0cdb2-9803-4828-99cc-64b028591fff-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:43 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 -F qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de" returned: 0 in 0.510s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:43 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de is being set with open permissions: ugo+rw Feb 27 02:11:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:43 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1bf7efc1-0fe3-40c0-9eae-36d57f0dd139 tempest-SnapshotDependencyTests-1454701389 None] Lock "cinder-e6c0cdb2-9803-4828-99cc-64b028591fff-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:43 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de Feb 27 02:11:43 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:43 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1bf7efc1-0fe3-40c0-9eae-36d57f0dd139 tempest-SnapshotDependencyTests-1454701389 None] Acquiring lock "cinder-quobyte-e6c0cdb2-9803-4828-99cc-64b028591fff" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:43 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1bf7efc1-0fe3-40c0-9eae-36d57f0dd139 tempest-SnapshotDependencyTests-1454701389 None] Lock "cinder-quobyte-e6c0cdb2-9803-4828-99cc-64b028591fff" acquired by "delete_volume" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:43 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[8842d9d0-cb77-4bda-a93b-ae7074bd2ac6]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1bf7efc1-0fe3-40c0-9eae-36d57f0dd139 tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e6c0cdb2-9803-4828-99cc-64b028591fff {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:43 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e6c0cdb2-9803-4828-99cc-64b028591fff Feb 27 02:11:43 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:43 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de" returned: 0 in 0.440s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:43 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.info Feb 27 02:11:43 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:43 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b" returned: 0 in 0.548s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:43 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b Feb 27 02:11:43 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:43 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1bf7efc1-0fe3-40c0-9eae-36d57f0dd139 tempest-SnapshotDependencyTests-1454701389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e6c0cdb2-9803-4828-99cc-64b028591fff" returned: 0 in 0.516s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:43 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1bf7efc1-0fe3-40c0-9eae-36d57f0dd139 tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e6c0cdb2-9803-4828-99cc-64b028591fff {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:43 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e6c0cdb2-9803-4828-99cc-64b028591fff Feb 27 02:11:43 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:44 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.info" returned: 0 in 0.498s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:44 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.info is being set with open permissions: ugo+rw Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.info {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:44 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.info Feb 27 02:11:44 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:44 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae.a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b" returned: 0 in 0.491s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] Lock "cinder-quobyte-a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b" released by "_delete_snapshot" :: held 2.225s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] Lock "cinder-quobyte-01f4540f-548d-47ba-95f8-0797d2cfe5ae" released by "delete_snapshot" :: held 2.242s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] Created reservations ['81227285-389e-4a9a-b3fe-a308ca45c3ca', '7b31f53b-6926-4de8-8d75-2eac733106e4', '94a04fbb-d07d-4547-aaf2-e9e5f1c4ce10', 'a9bae65a-386c-4ee9-a35e-eb2581cc064a'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:44 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1bf7efc1-0fe3-40c0-9eae-36d57f0dd139 tempest-SnapshotDependencyTests-1454701389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e6c0cdb2-9803-4828-99cc-64b028591fff" returned: 0 in 0.489s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1bf7efc1-0fe3-40c0-9eae-36d57f0dd139 tempest-SnapshotDependencyTests-1454701389 None] Lock "cinder-quobyte-e6c0cdb2-9803-4828-99cc-64b028591fff" released by "delete_volume" :: held 1.044s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:44 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] Delete snapshot completed successfully. Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-49196240-45b0-4b7f-9545-f5af1cd8e2a0 tempest-CinderUnicodeTest-455412751 None] Lock "cinder-a4928c2f-b7c3-4fa5-bba7-7ecb72557b3b-delete_snapshot" released by "delete_snapshot" :: held 2.345s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-1bf7efc1-0fe3-40c0-9eae-36d57f0dd139 tempest-SnapshotDependencyTests-1454701389 None] Created reservations ['0a380fc2-1a84-426e-b437-bd5178ef621b', 'b41aee8e-b704-4051-933a-fc8f3ba8f938', 'c6ff2b16-503b-4d76-b9ce-3b1cb2d9e6d5', '72e8f93a-8338-4c9a-ba7d-54eb7e5f8aeb'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1bf7efc1-0fe3-40c0-9eae-36d57f0dd139 tempest-SnapshotDependencyTests-1454701389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1bf7efc1-0fe3-40c0-9eae-36d57f0dd139 tempest-SnapshotDependencyTests-1454701389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1bf7efc1-0fe3-40c0-9eae-36d57f0dd139 tempest-SnapshotDependencyTests-1454701389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1bf7efc1-0fe3-40c0-9eae-36d57f0dd139 tempest-SnapshotDependencyTests-1454701389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1bf7efc1-0fe3-40c0-9eae-36d57f0dd139 tempest-SnapshotDependencyTests-1454701389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1bf7efc1-0fe3-40c0-9eae-36d57f0dd139 tempest-SnapshotDependencyTests-1454701389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:44 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:11:44 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:44 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.info" returned: 0 in 0.485s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "cinder-quobyte-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f" by "_copy_volume_from_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-quobyte-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] snapshot: a874ad41-d670-4f16-a725-37a0cdca33de, volume: e1e11a93-bfaf-43f6-9f3f-00ce6154a54f, {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fa8cfc-6609-4c9f-b411-18a438596be4]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:44 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de Feb 27 02:11:44 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:44 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1bf7efc1-0fe3-40c0-9eae-36d57f0dd139 tempest-SnapshotDependencyTests-1454701389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.443s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-1bf7efc1-0fe3-40c0-9eae-36d57f0dd139 tempest-SnapshotDependencyTests-1454701389 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:44 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-1bf7efc1-0fe3-40c0-9eae-36d57f0dd139 tempest-SnapshotDependencyTests-1454701389 None] Deleted volume successfully. Feb 27 02:11:44 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1bf7efc1-0fe3-40c0-9eae-36d57f0dd139 tempest-SnapshotDependencyTests-1454701389 None] Lock "cinder-e6c0cdb2-9803-4828-99cc-64b028591fff-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:45 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d6a8a2cf-1bc4-4660-a3c7-bdc544f84dcc tempest-CinderUnicodeTest-455412751 None] Acquiring lock "cinder-01f4540f-548d-47ba-95f8-0797d2cfe5ae-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:45 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d6a8a2cf-1bc4-4660-a3c7-bdc544f84dcc tempest-CinderUnicodeTest-455412751 None] Lock "cinder-01f4540f-548d-47ba-95f8-0797d2cfe5ae-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:45 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d6a8a2cf-1bc4-4660-a3c7-bdc544f84dcc tempest-CinderUnicodeTest-455412751 None] Acquiring lock "cinder-quobyte-01f4540f-548d-47ba-95f8-0797d2cfe5ae" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:45 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d6a8a2cf-1bc4-4660-a3c7-bdc544f84dcc tempest-CinderUnicodeTest-455412751 None] Lock "cinder-quobyte-01f4540f-548d-47ba-95f8-0797d2cfe5ae" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:45 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0558ee0a-8291-44d2-ba1d-8f577120877d]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d6a8a2cf-1bc4-4660-a3c7-bdc544f84dcc tempest-CinderUnicodeTest-455412751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:45 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de" returned: 0 in 0.573s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:11:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] will copy from snapshot at /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 27 02:11:45 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Creating direct copy from snapshot {{(pid=82683) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 27 02:11:45 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf86a40-1925-473a-b799-fba3efc5de22]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:45 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae Feb 27 02:11:45 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:45 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 Feb 27 02:11:45 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:45 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d6a8a2cf-1bc4-4660-a3c7-bdc544f84dcc tempest-CinderUnicodeTest-455412751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae" returned: 0 in 0.537s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d6a8a2cf-1bc4-4660-a3c7-bdc544f84dcc tempest-CinderUnicodeTest-455412751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:45 devstack sudo[90742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae Feb 27 02:11:45 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:45 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6" returned: 0 in 0.576s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:45 devstack cinder-volume[82683]: DEBUG cinder.utils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Path /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f not found in is_blk_device check {{(pid=82683) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 27 02:11:45 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:46 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f Feb 27 02:11:46 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:46 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d6a8a2cf-1bc4-4660-a3c7-bdc544f84dcc tempest-CinderUnicodeTest-455412751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-01f4540f-548d-47ba-95f8-0797d2cfe5ae" returned: 0 in 0.441s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:46 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d6a8a2cf-1bc4-4660-a3c7-bdc544f84dcc tempest-CinderUnicodeTest-455412751 None] Lock "cinder-quobyte-01f4540f-548d-47ba-95f8-0797d2cfe5ae" released by "delete_volume" :: held 1.020s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:46 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-d6a8a2cf-1bc4-4660-a3c7-bdc544f84dcc tempest-CinderUnicodeTest-455412751 None] Created reservations ['dfedd346-180e-4923-9e94-bebea4f11070', 'a2f15f3c-7f03-451e-9edf-f71549d7e541', 'aab3e619-942d-42a6-83fc-1f3ffbc1eb52', '1bc197f8-8a11-47de-9889-6763b4042e24'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d6a8a2cf-1bc4-4660-a3c7-bdc544f84dcc tempest-CinderUnicodeTest-455412751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d6a8a2cf-1bc4-4660-a3c7-bdc544f84dcc tempest-CinderUnicodeTest-455412751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d6a8a2cf-1bc4-4660-a3c7-bdc544f84dcc tempest-CinderUnicodeTest-455412751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:46 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-d6a8a2cf-1bc4-4660-a3c7-bdc544f84dcc tempest-CinderUnicodeTest-455412751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-d6a8a2cf-1bc4-4660-a3c7-bdc544f84dcc tempest-CinderUnicodeTest-455412751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:46 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d6a8a2cf-1bc4-4660-a3c7-bdc544f84dcc tempest-CinderUnicodeTest-455412751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:46 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:11:46 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:47 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-d6a8a2cf-1bc4-4660-a3c7-bdc544f84dcc tempest-CinderUnicodeTest-455412751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.663s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:47 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-d6a8a2cf-1bc4-4660-a3c7-bdc544f84dcc tempest-CinderUnicodeTest-455412751 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:47 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-d6a8a2cf-1bc4-4660-a3c7-bdc544f84dcc tempest-CinderUnicodeTest-455412751 None] Deleted volume successfully. Feb 27 02:11:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-d6a8a2cf-1bc4-4660-a3c7-bdc544f84dcc tempest-CinderUnicodeTest-455412751 None] Lock "cinder-01f4540f-548d-47ba-95f8-0797d2cfe5ae-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-89497209-9d09-49d3-9e36-765e9f799ed5 tempest-CinderUnicodeTest-455412751 None] Acquiring lock "cinder-0d912065-cfb4-4008-8f65-0822b62cd837-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-89497209-9d09-49d3-9e36-765e9f799ed5 tempest-CinderUnicodeTest-455412751 None] Lock "cinder-0d912065-cfb4-4008-8f65-0822b62cd837-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-89497209-9d09-49d3-9e36-765e9f799ed5 tempest-CinderUnicodeTest-455412751 None] Acquiring lock "cinder-quobyte-0d912065-cfb4-4008-8f65-0822b62cd837" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:47 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-89497209-9d09-49d3-9e36-765e9f799ed5 tempest-CinderUnicodeTest-455412751 None] Lock "cinder-quobyte-0d912065-cfb4-4008-8f65-0822b62cd837" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:47 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda19d63-736f-4c70-a198-6abe7c058734]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:47 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-89497209-9d09-49d3-9e36-765e9f799ed5 tempest-CinderUnicodeTest-455412751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0d912065-cfb4-4008-8f65-0822b62cd837 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:47 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0d912065-cfb4-4008-8f65-0822b62cd837 Feb 27 02:11:47 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:48 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f" returned: 0 in 2.572s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:48 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[431944ec-1c0c-4827-8766-9c95dce0f308]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:48 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 Feb 27 02:11:48 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:48 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-89497209-9d09-49d3-9e36-765e9f799ed5 tempest-CinderUnicodeTest-455412751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0d912065-cfb4-4008-8f65-0822b62cd837" returned: 0 in 1.168s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:48 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-89497209-9d09-49d3-9e36-765e9f799ed5 tempest-CinderUnicodeTest-455412751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0d912065-cfb4-4008-8f65-0822b62cd837 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:48 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0d912065-cfb4-4008-8f65-0822b62cd837 Feb 27 02:11:48 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:49 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6" returned: 0 in 0.691s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:49 devstack cinder-volume[82683]: DEBUG cinder.image.image_utils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Image conversion details: src /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6, size 1024.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f {{(pid=82683) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 27 02:11:49 devstack cinder-volume[82683]: INFO cinder.image.image_utils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Converted 1024.00 MB image at 397.88 MB/s Feb 27 02:11:49 devstack cinder-volume[82683]: WARNING cinder.volume.drivers.remotefs [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f is being set with open permissions: ugo+rw Feb 27 02:11:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:49 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f Feb 27 02:11:49 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:49 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-89497209-9d09-49d3-9e36-765e9f799ed5 tempest-CinderUnicodeTest-455412751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-0d912065-cfb4-4008-8f65-0822b62cd837" returned: 0 in 0.460s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:49 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-89497209-9d09-49d3-9e36-765e9f799ed5 tempest-CinderUnicodeTest-455412751 None] Lock "cinder-quobyte-0d912065-cfb4-4008-8f65-0822b62cd837" released by "delete_volume" :: held 1.666s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:49 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-89497209-9d09-49d3-9e36-765e9f799ed5 tempest-CinderUnicodeTest-455412751 None] Created reservations ['3474e317-5398-416b-be87-e1ba96073237', '48572258-5f5c-4b5c-a78d-be2e7f6b422e', 'df806350-5106-4346-9985-2db74281eebf', 'ce3c8362-cc56-4a9b-a1e4-03a9080de574'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-89497209-9d09-49d3-9e36-765e9f799ed5 tempest-CinderUnicodeTest-455412751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-89497209-9d09-49d3-9e36-765e9f799ed5 tempest-CinderUnicodeTest-455412751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-89497209-9d09-49d3-9e36-765e9f799ed5 tempest-CinderUnicodeTest-455412751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-89497209-9d09-49d3-9e36-765e9f799ed5 tempest-CinderUnicodeTest-455412751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-89497209-9d09-49d3-9e36-765e9f799ed5 tempest-CinderUnicodeTest-455412751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-89497209-9d09-49d3-9e36-765e9f799ed5 tempest-CinderUnicodeTest-455412751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:49 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:11:49 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:49 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f" returned: 0 in 0.511s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:49 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-quobyte-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f" released by "_copy_volume_from_snapshot" :: held 4.977s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:49 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "cinder-quobyte-a874ad41-d670-4f16-a725-37a0cdca33de" by "_delete_snapshot" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:49 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-quobyte-a874ad41-d670-4f16-a725-37a0cdca33de" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Deleting offline snapshot a874ad41-d670-4f16-a725-37a0cdca33de of volume b3c742f3-d3d7-42ed-b16c-db42bffabdf6 {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 27 02:11:49 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] snapshot_file for this snap is: volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de {{(pid=82683) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 27 02:11:49 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[4529dbeb-e288-4c82-bf6d-f5b46e30cb23]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:49 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:49 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de Feb 27 02:11:49 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:50 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-89497209-9d09-49d3-9e36-765e9f799ed5 tempest-CinderUnicodeTest-455412751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.552s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:50 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-89497209-9d09-49d3-9e36-765e9f799ed5 tempest-CinderUnicodeTest-455412751 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:50 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-89497209-9d09-49d3-9e36-765e9f799ed5 tempest-CinderUnicodeTest-455412751 None] Deleted volume successfully. Feb 27 02:11:50 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-89497209-9d09-49d3-9e36-765e9f799ed5 tempest-CinderUnicodeTest-455412751 None] Lock "cinder-0d912065-cfb4-4008-8f65-0822b62cd837-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:50 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de" returned: 0 in 0.656s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:50 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82683) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 27 02:11:50 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f38eaf-31b8-40f9-8fc3-d7a08fd8abdf]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:50 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:50 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 Feb 27 02:11:50 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:51 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6" returned: 0 in 0.682s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:51 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de Feb 27 02:11:51 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:51 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de" returned: 0 in 0.549s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:51 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:51 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de Feb 27 02:11:51 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:52 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6.a874ad41-d670-4f16-a725-37a0cdca33de" returned: 0 in 0.477s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-quobyte-a874ad41-d670-4f16-a725-37a0cdca33de" released by "_delete_snapshot" :: held 2.429s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.611s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.149s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-537211817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d691cbad-31f3-4c40-aaa9-8f760c9d2110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9ce3c7b7d74c038b0e612a6d19f242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:41Z,use_quota=True,user_id='ef7ef56d3d7b45f1ab7a044f54bd3774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Creating volume d691cbad-31f3-4c40-aaa9-8f760c9d2110 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:52 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d691cbad-31f3-4c40-aaa9-8f760c9d2110 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434a7fd8-706e-4673-a573-5a923a90358a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f', 'volume_size': 1, 'source_volid': 'b3c742f3-d3d7-42ed-b16c-db42bffabdf6', 'source_volstatus': 'available'}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:52 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d691cbad-31f3-4c40-aaa9-8f760c9d2110 1073741824 Feb 27 02:11:52 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b869a259-932d-4baa-a022-b4ee484f701e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:52 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Volume volume-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f (e1e11a93-bfaf-43f6-9f3f-00ce6154a54f): created successfully Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b869a259-932d-4baa-a022-b4ee484f701e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Flow 'volume_create_manager' (6b90860e-5786-4463-8ad7-1720e91f73f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:52 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-f2d026f9-4efe-4e59-a607-72ce4adffab9 tempest-VolumeDependencyTests-1785253996 None] Created volume successfully. Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6fbbdebe-57df-42af-993b-eb3a5f22849d tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "cinder-b3c742f3-d3d7-42ed-b16c-db42bffabdf6-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:52 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6fbbdebe-57df-42af-993b-eb3a5f22849d tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-b3c742f3-d3d7-42ed-b16c-db42bffabdf6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d691cbad-31f3-4c40-aaa9-8f760c9d2110 1073741824" returned: 0 in 0.579s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:SELECT=157,cinder:UPDATE=211,cinder:INSERT=56,cinder:DELETE=15 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6fbbdebe-57df-42af-993b-eb3a5f22849d tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "cinder-quobyte-b3c742f3-d3d7-42ed-b16c-db42bffabdf6" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6fbbdebe-57df-42af-993b-eb3a5f22849d tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-quobyte-b3c742f3-d3d7-42ed-b16c-db42bffabdf6" acquired by "delete_volume" :: waited 0.015s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d691cbad-31f3-4c40-aaa9-8f760c9d2110 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c93240b-60dc-4ca5-b984-db5cf6f3398a]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:52 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6fbbdebe-57df-42af-993b-eb3a5f22849d tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:52 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d691cbad-31f3-4c40-aaa9-8f760c9d2110 Feb 27 02:11:52 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:53 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 Feb 27 02:11:53 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:53 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d691cbad-31f3-4c40-aaa9-8f760c9d2110" returned: 0 in 0.424s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:53 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:53 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a11bbace-7776-4fee-a6c0-5cc29aed68c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d691cbad-31f3-4c40-aaa9-8f760c9d2110', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:53 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208f0434-1136-4425-8149-093be17dc058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:53 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Volume volume-d691cbad-31f3-4c40-aaa9-8f760c9d2110 (d691cbad-31f3-4c40-aaa9-8f760c9d2110): created successfully Feb 27 02:11:53 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208f0434-1136-4425-8149-093be17dc058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:53 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Flow 'volume_create_manager' (8db1c7b1-bce5-4adb-8f09-239f544166ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:53 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:UPDATE=219,cinder:SELECT=165,cinder:DELETE=24,cinder:INSERT=48 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:11:53 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-696b630b-a14a-4dd3-ba1c-16691bc51c94 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Created volume successfully. Feb 27 02:11:53 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6fbbdebe-57df-42af-993b-eb3a5f22849d tempest-VolumeDependencyTests-1785253996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6" returned: 0 in 0.504s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6fbbdebe-57df-42af-993b-eb3a5f22849d tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:53 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6 Feb 27 02:11:53 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:53 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:53 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6fbbdebe-57df-42af-993b-eb3a5f22849d tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b3c742f3-d3d7-42ed-b16c-db42bffabdf6" returned: 0 in 0.517s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:53 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6fbbdebe-57df-42af-993b-eb3a5f22849d tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-quobyte-b3c742f3-d3d7-42ed-b16c-db42bffabdf6" released by "delete_volume" :: held 1.059s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-6fbbdebe-57df-42af-993b-eb3a5f22849d tempest-VolumeDependencyTests-1785253996 None] Created reservations ['17200854-a169-45d7-980e-87393f466f36', 'efaec2a2-15a1-4219-adb0-c238efc41876', 'e5442465-f021-458c-8c02-c6344ce20033', 'ddb94c3a-7dce-4a6b-93b0-1e2360f43cfc'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6fbbdebe-57df-42af-993b-eb3a5f22849d tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6fbbdebe-57df-42af-993b-eb3a5f22849d tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6fbbdebe-57df-42af-993b-eb3a5f22849d tempest-VolumeDependencyTests-1785253996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6fbbdebe-57df-42af-993b-eb3a5f22849d tempest-VolumeDependencyTests-1785253996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6fbbdebe-57df-42af-993b-eb3a5f22849d tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6fbbdebe-57df-42af-993b-eb3a5f22849d tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:54 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:11:54 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Flow 'volume_create_manager' (12028220-4949-4595-bdab-a6448e2f3d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a3fbb0-64d2-49fc-855e-385ab7311e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a3fbb0-64d2-49fc-855e-385ab7311e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1447612483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c9f718-62d3-4317-a111-40073b9c805b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9ce3c7b7d74c038b0e612a6d19f242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:54Z,use_quota=True,user_id='ef7ef56d3d7b45f1ab7a044f54bd3774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ecab5bd-adf8-4322-b6ce-b17beacafd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ecab5bd-adf8-4322-b6ce-b17beacafd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625ee5b6-6d53-48d2-acd4-495b033aeb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625ee5b6-6d53-48d2-acd4-495b033aeb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c9f718-62d3-4317-a111-40073b9c805b', 'volume_name': 'volume-53c9f718-62d3-4317-a111-40073b9c805b', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434a5709-903a-469e-b223-1c460f1cc7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434a5709-903a-469e-b223-1c460f1cc7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f875d3fe-1204-4603-a694-cb8c78edfbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:54 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Volume 53c9f718-62d3-4317-a111-40073b9c805b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c9f718-62d3-4317-a111-40073b9c805b', 'volume_size': 1} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1447612483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c9f718-62d3-4317-a111-40073b9c805b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9ce3c7b7d74c038b0e612a6d19f242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:54Z,use_quota=True,user_id='ef7ef56d3d7b45f1ab7a044f54bd3774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Creating volume 53c9f718-62d3-4317-a111-40073b9c805b {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:54 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-53c9f718-62d3-4317-a111-40073b9c805b 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:54 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-53c9f718-62d3-4317-a111-40073b9c805b 1073741824 Feb 27 02:11:54 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:54 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Flow 'volume_create_manager' (ce8b69b8-f0dd-456d-bd24-1182efb15f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bbd491c-4c3f-4f09-8dce-7c4cfc1e02d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bbd491c-4c3f-4f09-8dce-7c4cfc1e02d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1873039626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb3e019-6a4d-416a-a6aa-fa604f494ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9ce3c7b7d74c038b0e612a6d19f242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:55Z,use_quota=True,user_id='ef7ef56d3d7b45f1ab7a044f54bd3774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd784ba-4493-485d-b14f-d70b8c917b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dd784ba-4493-485d-b14f-d70b8c917b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e3ba45-3b7a-4b3c-b485-c7d67dd36c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e3ba45-3b7a-4b3c-b485-c7d67dd36c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeb3e019-6a4d-416a-a6aa-fa604f494ef2', 'volume_name': 'volume-eeb3e019-6a4d-416a-a6aa-fa604f494ef2', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7592056-18c5-4bcd-8102-e7eed5c866d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7592056-18c5-4bcd-8102-e7eed5c866d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f923e62f-7d4b-4725-93d2-56893635e609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:54 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Volume eeb3e019-6a4d-416a-a6aa-fa604f494ef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeb3e019-6a4d-416a-a6aa-fa604f494ef2', 'volume_size': 1} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6fbbdebe-57df-42af-993b-eb3a5f22849d tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.686s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-6fbbdebe-57df-42af-993b-eb3a5f22849d tempest-VolumeDependencyTests-1785253996 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:54 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-6fbbdebe-57df-42af-993b-eb3a5f22849d tempest-VolumeDependencyTests-1785253996 None] Deleted volume successfully. Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-6fbbdebe-57df-42af-993b-eb3a5f22849d tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-b3c742f3-d3d7-42ed-b16c-db42bffabdf6-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Flow 'volume_create_manager' (979d53a9-933d-43fa-95fc-68934cfc7d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392859b7-7e9b-45ba-8329-cd012054beb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392859b7-7e9b-45ba-8329-cd012054beb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1887808098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9ce3c7b7d74c038b0e612a6d19f242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:55Z,use_quota=True,user_id='ef7ef56d3d7b45f1ab7a044f54bd3774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9fed743-3d29-4e8e-8534-be34e195152d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9fed743-3d29-4e8e-8534-be34e195152d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (645351bb-b4d2-41c9-b314-5aefb184df5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (645351bb-b4d2-41c9-b314-5aefb184df5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b', 'volume_name': 'volume-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a0c426-9a19-47d5-9526-219c2546cd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a0c426-9a19-47d5-9526-219c2546cd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd63219-2b73-49eb-ba0d-4d0ee13fc9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:54 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Volume 5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b', 'volume_size': 1} Feb 27 02:11:54 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f16eb0ed-e6d8-4f74-bb08-31ff96538396 tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "cinder-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f16eb0ed-e6d8-4f74-bb08-31ff96538396 tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f16eb0ed-e6d8-4f74-bb08-31ff96538396 tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "cinder-quobyte-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f16eb0ed-e6d8-4f74-bb08-31ff96538396 tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-quobyte-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f" acquired by "delete_volume" :: waited 0.017s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[19081ad2-ef5e-491f-8b67-54ce7dae0299]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f16eb0ed-e6d8-4f74-bb08-31ff96538396 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:55 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Flow 'volume_create_manager' (611cf1d8-0c76-4c84-9614-fb434167e75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:55 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff7bc55-729c-4875-a886-bf6d41af867c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:55 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-53c9f718-62d3-4317-a111-40073b9c805b 1073741824" returned: 0 in 0.828s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff7bc55-729c-4875-a886-bf6d41af867c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1407882135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9ce3c7b7d74c038b0e612a6d19f242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:55Z,use_quota=True,user_id='ef7ef56d3d7b45f1ab7a044f54bd3774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44421266-6299-4e58-b74a-35de3014a39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44421266-6299-4e58-b74a-35de3014a39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c18c5d18-a8e2-48ec-b5c4-40a1e588cd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c18c5d18-a8e2-48ec-b5c4-40a1e588cd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4', 'volume_name': 'volume-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba0863c-3355-4985-a742-066448986932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba0863c-3355-4985-a742-066448986932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891aea1a-6e01-488d-a795-67dd6de8ca61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:55 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Volume 9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4', 'volume_size': 1} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-53c9f718-62d3-4317-a111-40073b9c805b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:55 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-53c9f718-62d3-4317-a111-40073b9c805b Feb 27 02:11:55 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.flows.manager.create_volume [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82683) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Flow 'volume_create_manager' (b113bdb9-85aa-430f-a632-92e29a57a131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841f51f9-b61e-4423-ac9c-9605fec55690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841f51f9-b61e-4423-ac9c-9605fec55690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1660515698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9ce3c7b7d74c038b0e612a6d19f242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:55Z,use_quota=True,user_id='ef7ef56d3d7b45f1ab7a044f54bd3774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff26c00-d50f-4fbc-a1c0-a9454f786bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff26c00-d50f-4fbc-a1c0-a9454f786bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b9bdc3-4c91-4c51-b45b-a4c341928cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b9bdc3-4c91-4c51-b45b-a4c341928cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8', 'volume_name': 'volume-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337873d1-7952-4ef8-971e-fab56fe584c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337873d1-7952-4ef8-971e-fab56fe584c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2110a80-1b2f-4dd1-9ca8-fe84e94b7937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:55 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Volume 4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8', 'volume_size': 1} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:55 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f16eb0ed-e6d8-4f74-bb08-31ff96538396 tempest-VolumeDependencyTests-1785253996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f" returned: 0 in 0.616s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f16eb0ed-e6d8-4f74-bb08-31ff96538396 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:55 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f Feb 27 02:11:55 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:55 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-53c9f718-62d3-4317-a111-40073b9c805b" returned: 0 in 0.532s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.126s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1873039626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb3e019-6a4d-416a-a6aa-fa604f494ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9ce3c7b7d74c038b0e612a6d19f242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:55Z,use_quota=True,user_id='ef7ef56d3d7b45f1ab7a044f54bd3774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Creating volume eeb3e019-6a4d-416a-a6aa-fa604f494ef2 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:55 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eeb3e019-6a4d-416a-a6aa-fa604f494ef2 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f875d3fe-1204-4603-a694-cb8c78edfbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c9f718-62d3-4317-a111-40073b9c805b', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab16900f-6aa4-4ab7-868e-4ff2c57d9054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:55 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eeb3e019-6a4d-416a-a6aa-fa604f494ef2 1073741824 Feb 27 02:11:55 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:55 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Volume volume-53c9f718-62d3-4317-a111-40073b9c805b (53c9f718-62d3-4317-a111-40073b9c805b): created successfully Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab16900f-6aa4-4ab7-868e-4ff2c57d9054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:55 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Flow 'volume_create_manager' (12028220-4949-4595-bdab-a6448e2f3d0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:55 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-4d3c20b5-92e4-41ea-85ff-96b84e4f02c2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Created volume successfully. Feb 27 02:11:56 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f16eb0ed-e6d8-4f74-bb08-31ff96538396 tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f" returned: 0 in 0.480s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f16eb0ed-e6d8-4f74-bb08-31ff96538396 tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-quobyte-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f" released by "delete_volume" :: held 1.123s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-f16eb0ed-e6d8-4f74-bb08-31ff96538396 tempest-VolumeDependencyTests-1785253996 None] Created reservations ['6c25f13e-5433-4f54-9e58-6fb2afc55664', 'fd8e06ff-abff-4d45-85d1-3c2573853428', '0ad5a5f7-c5ae-4ab1-8097-72e539550324', '8ac6e727-ced5-4cb7-8501-7a602539d7c1'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f16eb0ed-e6d8-4f74-bb08-31ff96538396 tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f16eb0ed-e6d8-4f74-bb08-31ff96538396 tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f16eb0ed-e6d8-4f74-bb08-31ff96538396 tempest-VolumeDependencyTests-1785253996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-f16eb0ed-e6d8-4f74-bb08-31ff96538396 tempest-VolumeDependencyTests-1785253996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-f16eb0ed-e6d8-4f74-bb08-31ff96538396 tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f16eb0ed-e6d8-4f74-bb08-31ff96538396 tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:56 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:11:56 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:56 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eeb3e019-6a4d-416a-a6aa-fa604f494ef2 1073741824" returned: 0 in 0.582s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eeb3e019-6a4d-416a-a6aa-fa604f494ef2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:56 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eeb3e019-6a4d-416a-a6aa-fa604f494ef2 Feb 27 02:11:56 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:56 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-f16eb0ed-e6d8-4f74-bb08-31ff96538396 tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.441s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-f16eb0ed-e6d8-4f74-bb08-31ff96538396 tempest-VolumeDependencyTests-1785253996 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:56 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-f16eb0ed-e6d8-4f74-bb08-31ff96538396 tempest-VolumeDependencyTests-1785253996 None] Deleted volume successfully. Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-f16eb0ed-e6d8-4f74-bb08-31ff96538396 tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-e1e11a93-bfaf-43f6-9f3f-00ce6154a54f-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:56 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eeb3e019-6a4d-416a-a6aa-fa604f494ef2" returned: 0 in 0.439s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.972s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1887808098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9ce3c7b7d74c038b0e612a6d19f242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:55Z,use_quota=True,user_id='ef7ef56d3d7b45f1ab7a044f54bd3774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Creating volume 5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:56 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:56 devstack sudo[90848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b 1073741824 Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f923e62f-7d4b-4725-93d2-56893635e609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeb3e019-6a4d-416a-a6aa-fa604f494ef2', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:56 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4384cbb8-d7e2-4dae-8406-c66b5c4e9fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:56 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Volume volume-eeb3e019-6a4d-416a-a6aa-fa604f494ef2 (eeb3e019-6a4d-416a-a6aa-fa604f494ef2): created successfully Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4384cbb8-d7e2-4dae-8406-c66b5c4e9fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:56 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Flow 'volume_create_manager' (ce8b69b8-f0dd-456d-bd24-1182efb15f0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:57 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-830a0c55-ad28-4ff2-a6d0-424f0e81776d tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Created volume successfully. Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2c07726d-f6c5-433c-bad7-62c1454cc42e tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "cinder-b620ac97-fea0-41cb-beb4-93859299e74e-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2c07726d-f6c5-433c-bad7-62c1454cc42e tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-b620ac97-fea0-41cb-beb4-93859299e74e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2c07726d-f6c5-433c-bad7-62c1454cc42e tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "cinder-quobyte-b620ac97-fea0-41cb-beb4-93859299e74e" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2c07726d-f6c5-433c-bad7-62c1454cc42e tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-quobyte-b620ac97-fea0-41cb-beb4-93859299e74e" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[268b944c-3675-486b-9794-43d764e7c30f]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2c07726d-f6c5-433c-bad7-62c1454cc42e tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b620ac97-fea0-41cb-beb4-93859299e74e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:57 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b620ac97-fea0-41cb-beb4-93859299e74e Feb 27 02:11:57 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:57 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b 1073741824" returned: 0 in 0.551s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:57 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b Feb 27 02:11:57 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:57 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2c07726d-f6c5-433c-bad7-62c1454cc42e tempest-VolumeDependencyTests-1785253996 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b620ac97-fea0-41cb-beb4-93859299e74e" returned: 0 in 0.509s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2c07726d-f6c5-433c-bad7-62c1454cc42e tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b620ac97-fea0-41cb-beb4-93859299e74e {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:57 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b620ac97-fea0-41cb-beb4-93859299e74e Feb 27 02:11:57 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:57 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b" returned: 0 in 0.417s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.639s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1407882135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9ce3c7b7d74c038b0e612a6d19f242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:55Z,use_quota=True,user_id='ef7ef56d3d7b45f1ab7a044f54bd3774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Creating volume 9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:57 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd63219-2b73-49eb-ba0d-4d0ee13fc9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:57 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97acbdc1-6018-4517-a886-574e4716b7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:57 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4 1073741824 Feb 27 02:11:57 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:57 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Volume volume-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b (5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b): created successfully Feb 27 02:11:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97acbdc1-6018-4517-a886-574e4716b7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:58 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Flow 'volume_create_manager' (979d53a9-933d-43fa-95fc-68934cfc7d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:58 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-6ed7c02c-826b-40df-abc6-c1aab7db5930 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Created volume successfully. Feb 27 02:11:58 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2c07726d-f6c5-433c-bad7-62c1454cc42e tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-b620ac97-fea0-41cb-beb4-93859299e74e" returned: 0 in 0.428s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:58 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2c07726d-f6c5-433c-bad7-62c1454cc42e tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-quobyte-b620ac97-fea0-41cb-beb4-93859299e74e" released by "delete_volume" :: held 0.964s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:58 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-2c07726d-f6c5-433c-bad7-62c1454cc42e tempest-VolumeDependencyTests-1785253996 None] Created reservations ['1d9241ea-ee6f-47c2-93fa-5ea0d9920a28', '4b599197-e575-4d65-8dc7-56f112725166', 'f2f8cee1-cf23-4803-a168-72541e9272d9', '92094a61-2dfa-4b8f-bbe9-5928199a77b2'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:11:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2c07726d-f6c5-433c-bad7-62c1454cc42e tempest-VolumeDependencyTests-1785253996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2c07726d-f6c5-433c-bad7-62c1454cc42e tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:58 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2c07726d-f6c5-433c-bad7-62c1454cc42e tempest-VolumeDependencyTests-1785253996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:58 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-2c07726d-f6c5-433c-bad7-62c1454cc42e tempest-VolumeDependencyTests-1785253996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-2c07726d-f6c5-433c-bad7-62c1454cc42e tempest-VolumeDependencyTests-1785253996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2c07726d-f6c5-433c-bad7-62c1454cc42e tempest-VolumeDependencyTests-1785253996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:58 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:11:58 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:58 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4 1073741824" returned: 0 in 0.514s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:58 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4 Feb 27 02:11:58 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:58 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:58 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-2c07726d-f6c5-433c-bad7-62c1454cc42e tempest-VolumeDependencyTests-1785253996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.470s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:58 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-2c07726d-f6c5-433c-bad7-62c1454cc42e tempest-VolumeDependencyTests-1785253996 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:11:58 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-2c07726d-f6c5-433c-bad7-62c1454cc42e tempest-VolumeDependencyTests-1785253996 None] Deleted volume successfully. Feb 27 02:11:58 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-2c07726d-f6c5-433c-bad7-62c1454cc42e tempest-VolumeDependencyTests-1785253996 None] Lock "cinder-b620ac97-fea0-41cb-beb4-93859299e74e-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:11:59 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4" returned: 0 in 0.518s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:11:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.522s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-27T01:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1660515698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9ce3c7b7d74c038b0e612a6d19f242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-27T01:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-27T01:11:55Z,use_quota=True,user_id='ef7ef56d3d7b45f1ab7a044f54bd3774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7ae4d20-6253-4bd4-afc8-f911ef85aa06),volume_type_id=a7ae4d20-6253-4bd4-afc8-f911ef85aa06)}" {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 27 02:11:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.remotefs [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Creating volume 4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8 {{(pid=82683) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 27 02:11:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:11:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:11:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:11:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:11:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:11:59 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Selected osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 as target Quobyte volume. {{(pid=82683) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 27 02:11:59 devstack cinder-volume[82683]: INFO cinder.volume.drivers.remotefs [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] casted to osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3 Feb 27 02:11:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8 1073741824 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891aea1a-6e01-488d-a795-67dd6de8ca61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4133cc5-83a8-4166-b9b4-42e3cb02eeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:11:59 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8 1073741824 Feb 27 02:11:59 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:11:59 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Volume volume-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4 (9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4): created successfully Feb 27 02:11:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4133cc5-83a8-4166-b9b4-42e3cb02eeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:11:59 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Flow 'volume_create_manager' (611cf1d8-0c76-4c84-9614-fb434167e75c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:11:59 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-b0c16b84-0981-41ea-aba3-f5e438b45ef2 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Created volume successfully. Feb 27 02:11:59 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Feb 27 02:11:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8 1073741824" returned: 0 in 0.535s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:11:59 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:11:59 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8 Feb 27 02:11:59 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:00 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8" returned: 0 in 0.404s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:00 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'} {{(pid=82683) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 27 02:12:00 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:00 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2110a80-1b2f-4dd1-9ca8-fe84e94b7937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8', 'volume_size': 1}' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:00 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (877f764d-d0a3-4ce0-8998-0271289bf304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 27 02:12:00 devstack cinder-volume[82683]: INFO cinder.volume.flows.manager.create_volume [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Volume volume-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8 (4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8): created successfully Feb 27 02:12:00 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (877f764d-d0a3-4ce0-8998-0271289bf304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82683) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 27 02:12:00 devstack cinder-volume[82683]: DEBUG cinder.volume.manager [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Flow 'volume_create_manager' (b113bdb9-85aa-430f-a632-92e29a57a131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82683) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 27 02:12:00 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-32ea3b36-b8f6-4250-a18a-07ac7c671ea0 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Created volume successfully. Feb 27 02:12:00 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1c4bc865-9b3c-4e7e-9730-a1b9951e3a0e tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "cinder-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:00 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1c4bc865-9b3c-4e7e-9730-a1b9951e3a0e tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:00 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1c4bc865-9b3c-4e7e-9730-a1b9951e3a0e tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "cinder-quobyte-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:01 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1c4bc865-9b3c-4e7e-9730-a1b9951e3a0e tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-quobyte-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8" acquired by "delete_volume" :: waited 0.008s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:01 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[555f9875-e059-45f5-8ca8-5d363d2fd182]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1c4bc865-9b3c-4e7e-9730-a1b9951e3a0e tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:01 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8 Feb 27 02:12:01 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:01 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1c4bc865-9b3c-4e7e-9730-a1b9951e3a0e tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8" returned: 0 in 0.489s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1c4bc865-9b3c-4e7e-9730-a1b9951e3a0e tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:01 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8 Feb 27 02:12:01 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:01 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1c4bc865-9b3c-4e7e-9730-a1b9951e3a0e tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8" returned: 0 in 0.386s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:01 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1c4bc865-9b3c-4e7e-9730-a1b9951e3a0e tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-quobyte-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8" released by "delete_volume" :: held 0.898s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:01 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-1c4bc865-9b3c-4e7e-9730-a1b9951e3a0e tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Created reservations ['f980c01f-9f46-4c4e-ae45-670176219a2a', '45cdff70-4ca0-4058-8e67-c68cd3270fbf', '2d915a93-df53-4648-876d-e00f92fe0b42', '77e0a2a3-04c5-4273-9f1a-b54455b4e876'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1c4bc865-9b3c-4e7e-9730-a1b9951e3a0e tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1c4bc865-9b3c-4e7e-9730-a1b9951e3a0e tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1c4bc865-9b3c-4e7e-9730-a1b9951e3a0e tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:01 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-1c4bc865-9b3c-4e7e-9730-a1b9951e3a0e tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-1c4bc865-9b3c-4e7e-9730-a1b9951e3a0e tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:01 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1c4bc865-9b3c-4e7e-9730-a1b9951e3a0e tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:01 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:12:01 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:02 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0fffafdb-b1d2-466e-8f12-d00c6c7c23a6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "cinder-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:02 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0fffafdb-b1d2-466e-8f12-d00c6c7c23a6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:02 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0fffafdb-b1d2-466e-8f12-d00c6c7c23a6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "cinder-quobyte-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:02 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0fffafdb-b1d2-466e-8f12-d00c6c7c23a6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-quobyte-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4" acquired by "delete_volume" :: waited 0.018s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:02 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c6343c-ac2a-4341-8861-0a50dd3624aa]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0fffafdb-b1d2-466e-8f12-d00c6c7c23a6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:02 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4 Feb 27 02:12:02 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:02 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-1c4bc865-9b3c-4e7e-9730-a1b9951e3a0e tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.438s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:02 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-1c4bc865-9b3c-4e7e-9730-a1b9951e3a0e tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:02 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-1c4bc865-9b3c-4e7e-9730-a1b9951e3a0e tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Deleted volume successfully. Feb 27 02:12:02 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-1c4bc865-9b3c-4e7e-9730-a1b9951e3a0e tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-4c68b9d7-d9f0-4b27-9ca7-3cd539489ef8-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:02 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0fffafdb-b1d2-466e-8f12-d00c6c7c23a6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4" returned: 0 in 0.508s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:02 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0fffafdb-b1d2-466e-8f12-d00c6c7c23a6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:02 devstack sudo[90900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4 Feb 27 02:12:02 devstack sudo[90900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:03 devstack sudo[90900]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0fffafdb-b1d2-466e-8f12-d00c6c7c23a6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4" returned: 0 in 0.414s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:03 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0fffafdb-b1d2-466e-8f12-d00c6c7c23a6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-quobyte-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4" released by "delete_volume" :: held 0.944s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:03 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-0fffafdb-b1d2-466e-8f12-d00c6c7c23a6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Created reservations ['c419bfd4-3e69-4df0-a6e4-69b00623e942', '46a0f3b0-727b-43d0-bb04-9e96bb1e72d6', '2f467568-003f-41ca-8126-be50f4d1b03a', '6a8a7055-3fcf-4673-9125-fd8bed072f9e'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0fffafdb-b1d2-466e-8f12-d00c6c7c23a6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0fffafdb-b1d2-466e-8f12-d00c6c7c23a6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0fffafdb-b1d2-466e-8f12-d00c6c7c23a6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:03 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-0fffafdb-b1d2-466e-8f12-d00c6c7c23a6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-0fffafdb-b1d2-466e-8f12-d00c6c7c23a6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0fffafdb-b1d2-466e-8f12-d00c6c7c23a6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:03 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:12:03 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:03 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-da0844f1-a5b0-46e2-88c7-d41be811dca6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "cinder-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:03 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-da0844f1-a5b0-46e2-88c7-d41be811dca6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:03 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-da0844f1-a5b0-46e2-88c7-d41be811dca6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "cinder-quobyte-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:03 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-da0844f1-a5b0-46e2-88c7-d41be811dca6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-quobyte-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b" acquired by "delete_volume" :: waited 0.008s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:03 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a49bcb8-6541-4172-a817-6919eed66d62]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-da0844f1-a5b0-46e2-88c7-d41be811dca6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:03 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b Feb 27 02:12:03 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:03 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-0fffafdb-b1d2-466e-8f12-d00c6c7c23a6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.455s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:03 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-0fffafdb-b1d2-466e-8f12-d00c6c7c23a6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:03 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-0fffafdb-b1d2-466e-8f12-d00c6c7c23a6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Deleted volume successfully. Feb 27 02:12:03 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-0fffafdb-b1d2-466e-8f12-d00c6c7c23a6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-9d15abb0-9b4b-4e5b-94ab-8b11ee48b3d4-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:03 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-da0844f1-a5b0-46e2-88c7-d41be811dca6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b" returned: 0 in 0.472s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:03 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-da0844f1-a5b0-46e2-88c7-d41be811dca6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:03 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b Feb 27 02:12:03 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:04 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-da0844f1-a5b0-46e2-88c7-d41be811dca6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b" returned: 0 in 0.399s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-da0844f1-a5b0-46e2-88c7-d41be811dca6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-quobyte-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b" released by "delete_volume" :: held 0.898s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:04 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-da0844f1-a5b0-46e2-88c7-d41be811dca6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Created reservations ['2c4b8ff3-9ef8-4258-90a1-6ea684725a4c', 'ce390a45-44e6-4f57-bd9f-6ebf87fe03b4', 'eae02b6f-3411-4507-82e8-1595aaa63d14', 'a76a8bc8-d8f4-4625-8ffe-2b922098b468'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-da0844f1-a5b0-46e2-88c7-d41be811dca6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-da0844f1-a5b0-46e2-88c7-d41be811dca6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-da0844f1-a5b0-46e2-88c7-d41be811dca6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:04 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-da0844f1-a5b0-46e2-88c7-d41be811dca6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-da0844f1-a5b0-46e2-88c7-d41be811dca6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-da0844f1-a5b0-46e2-88c7-d41be811dca6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:04 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:12:04 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-c7ab8aad-f00c-4535-8980-672e1150b2b4 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "cinder-eeb3e019-6a4d-416a-a6aa-fa604f494ef2-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-c7ab8aad-f00c-4535-8980-672e1150b2b4 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-eeb3e019-6a4d-416a-a6aa-fa604f494ef2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-c7ab8aad-f00c-4535-8980-672e1150b2b4 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "cinder-quobyte-eeb3e019-6a4d-416a-a6aa-fa604f494ef2" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-c7ab8aad-f00c-4535-8980-672e1150b2b4 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-quobyte-eeb3e019-6a4d-416a-a6aa-fa604f494ef2" acquired by "delete_volume" :: waited 0.013s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:04 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87bfa01-f3ca-46a6-90bd-383773f78106]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c7ab8aad-f00c-4535-8980-672e1150b2b4 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eeb3e019-6a4d-416a-a6aa-fa604f494ef2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:04 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eeb3e019-6a4d-416a-a6aa-fa604f494ef2 Feb 27 02:12:04 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:04 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-da0844f1-a5b0-46e2-88c7-d41be811dca6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.433s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:04 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-da0844f1-a5b0-46e2-88c7-d41be811dca6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:04 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-da0844f1-a5b0-46e2-88c7-d41be811dca6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Deleted volume successfully. Feb 27 02:12:04 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-da0844f1-a5b0-46e2-88c7-d41be811dca6 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-5a8cb409-7ce7-4a89-85fd-90abd7ba7e4b-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:04 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c7ab8aad-f00c-4535-8980-672e1150b2b4 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eeb3e019-6a4d-416a-a6aa-fa604f494ef2" returned: 0 in 0.472s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:04 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c7ab8aad-f00c-4535-8980-672e1150b2b4 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eeb3e019-6a4d-416a-a6aa-fa604f494ef2 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:04 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eeb3e019-6a4d-416a-a6aa-fa604f494ef2 Feb 27 02:12:04 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:05 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c7ab8aad-f00c-4535-8980-672e1150b2b4 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-eeb3e019-6a4d-416a-a6aa-fa604f494ef2" returned: 0 in 0.398s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-c7ab8aad-f00c-4535-8980-672e1150b2b4 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-quobyte-eeb3e019-6a4d-416a-a6aa-fa604f494ef2" released by "delete_volume" :: held 0.892s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:05 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-c7ab8aad-f00c-4535-8980-672e1150b2b4 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Created reservations ['494f37d7-c13a-4c69-8bf6-a69a98be16b4', '54df33f2-25fd-47ac-879f-9a871d7f2e2c', '018ed032-0cd1-4e2d-8d90-f5d1e42a8689', 'f83cbc75-b244-447e-9fb3-c8d18ff3030e'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c7ab8aad-f00c-4535-8980-672e1150b2b4 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c7ab8aad-f00c-4535-8980-672e1150b2b4 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:05 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-c7ab8aad-f00c-4535-8980-672e1150b2b4 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:05 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-c7ab8aad-f00c-4535-8980-672e1150b2b4 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-c7ab8aad-f00c-4535-8980-672e1150b2b4 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c7ab8aad-f00c-4535-8980-672e1150b2b4 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:05 devstack sudo[90925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:12:05 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ea03ece8-5c22-49f8-89d6-009c8d0ecf42 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "cinder-53c9f718-62d3-4317-a111-40073b9c805b-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ea03ece8-5c22-49f8-89d6-009c8d0ecf42 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-53c9f718-62d3-4317-a111-40073b9c805b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ea03ece8-5c22-49f8-89d6-009c8d0ecf42 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "cinder-quobyte-53c9f718-62d3-4317-a111-40073b9c805b" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ea03ece8-5c22-49f8-89d6-009c8d0ecf42 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-quobyte-53c9f718-62d3-4317-a111-40073b9c805b" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:05 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[0837a39e-fedb-45cb-8771-4fc93d06c6c1]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ea03ece8-5c22-49f8-89d6-009c8d0ecf42 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-53c9f718-62d3-4317-a111-40073b9c805b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:05 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-53c9f718-62d3-4317-a111-40073b9c805b Feb 27 02:12:05 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:05 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:05 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-c7ab8aad-f00c-4535-8980-672e1150b2b4 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.467s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:05 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-c7ab8aad-f00c-4535-8980-672e1150b2b4 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:05 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-c7ab8aad-f00c-4535-8980-672e1150b2b4 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Deleted volume successfully. Feb 27 02:12:05 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-c7ab8aad-f00c-4535-8980-672e1150b2b4 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-eeb3e019-6a4d-416a-a6aa-fa604f494ef2-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:06 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ea03ece8-5c22-49f8-89d6-009c8d0ecf42 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-53c9f718-62d3-4317-a111-40073b9c805b" returned: 0 in 0.497s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ea03ece8-5c22-49f8-89d6-009c8d0ecf42 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-53c9f718-62d3-4317-a111-40073b9c805b {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:06 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-53c9f718-62d3-4317-a111-40073b9c805b Feb 27 02:12:06 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:06 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ea03ece8-5c22-49f8-89d6-009c8d0ecf42 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-53c9f718-62d3-4317-a111-40073b9c805b" returned: 0 in 0.402s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ea03ece8-5c22-49f8-89d6-009c8d0ecf42 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-quobyte-53c9f718-62d3-4317-a111-40073b9c805b" released by "delete_volume" :: held 0.921s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:06 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-ea03ece8-5c22-49f8-89d6-009c8d0ecf42 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Created reservations ['5aa096db-87ca-42ee-acbd-53aca552a158', 'bab10d26-12b4-4dd2-a00d-a1124c9ab581', 'ccc19c02-8cdb-4102-8402-99d39dcc8b3e', '7120036b-7f6b-44ca-bfa0-5147e09b3093'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ea03ece8-5c22-49f8-89d6-009c8d0ecf42 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ea03ece8-5c22-49f8-89d6-009c8d0ecf42 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:06 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ea03ece8-5c22-49f8-89d6-009c8d0ecf42 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:06 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-ea03ece8-5c22-49f8-89d6-009c8d0ecf42 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-ea03ece8-5c22-49f8-89d6-009c8d0ecf42 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ea03ece8-5c22-49f8-89d6-009c8d0ecf42 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:06 devstack sudo[90936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:12:06 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-89d5bed2-61eb-4c64-b4b8-666533a3d58f tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "cinder-d691cbad-31f3-4c40-aaa9-8f760c9d2110-delete_volume" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-89d5bed2-61eb-4c64-b4b8-666533a3d58f tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-d691cbad-31f3-4c40-aaa9-8f760c9d2110-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-89d5bed2-61eb-4c64-b4b8-666533a3d58f tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "cinder-quobyte-d691cbad-31f3-4c40-aaa9-8f760c9d2110" by "delete_volume" {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 27 02:12:06 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-89d5bed2-61eb-4c64-b4b8-666533a3d58f tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-quobyte-d691cbad-31f3-4c40-aaa9-8f760c9d2110" acquired by "delete_volume" :: waited 0.009s {{(pid=82683) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 27 02:12:06 devstack cinder-volume[82683]: DEBUG oslo.privsep.daemon [-] privsep: reply[857a0fb9-05a3-4a6e-9351-1a07659dd505]: (4, 'qcow2') {{(pid=83512) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 27 02:12:06 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-89d5bed2-61eb-4c64-b4b8-666533a3d58f tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d691cbad-31f3-4c40-aaa9-8f760c9d2110 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:06 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d691cbad-31f3-4c40-aaa9-8f760c9d2110 Feb 27 02:12:06 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:07 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-ea03ece8-5c22-49f8-89d6-009c8d0ecf42 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.454s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:07 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-ea03ece8-5c22-49f8-89d6-009c8d0ecf42 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:07 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-ea03ece8-5c22-49f8-89d6-009c8d0ecf42 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Deleted volume successfully. Feb 27 02:12:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-ea03ece8-5c22-49f8-89d6-009c8d0ecf42 tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-53c9f718-62d3-4317-a111-40073b9c805b-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:07 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-89d5bed2-61eb-4c64-b4b8-666533a3d58f tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d691cbad-31f3-4c40-aaa9-8f760c9d2110" returned: 0 in 0.480s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-89d5bed2-61eb-4c64-b4b8-666533a3d58f tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d691cbad-31f3-4c40-aaa9-8f760c9d2110 {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:07 devstack sudo[90944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d691cbad-31f3-4c40-aaa9-8f760c9d2110 Feb 27 02:12:07 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:07 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-89d5bed2-61eb-4c64-b4b8-666533a3d58f tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb/volume-d691cbad-31f3-4c40-aaa9-8f760c9d2110" returned: 0 in 0.465s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:07 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-89d5bed2-61eb-4c64-b4b8-666533a3d58f tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-quobyte-d691cbad-31f3-4c40-aaa9-8f760c9d2110" released by "delete_volume" :: held 0.968s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:07 devstack cinder-volume[82683]: DEBUG cinder.quota [None req-89d5bed2-61eb-4c64-b4b8-666533a3d58f tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Created reservations ['1fb4b058-2351-40ae-8fb8-a904a11bdb40', '61a25851-18d6-4584-8a19-cade62ab6bee', '2e3bfab8-e22e-4ff4-a291-08f5d7f9661e', '10e0c078-3dce-4f68-8b22-be23b97f17e9'] {{(pid=82683) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 27 02:12:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-89d5bed2-61eb-4c64-b4b8-666533a3d58f tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-89d5bed2-61eb-4c64-b4b8-666533a3d58f tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:07 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-89d5bed2-61eb-4c64-b4b8-666533a3d58f tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:07 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-89d5bed2-61eb-4c64-b4b8-666533a3d58f tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-89d5bed2-61eb-4c64-b4b8-666533a3d58f tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:07 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-89d5bed2-61eb-4c64-b4b8-666533a3d58f tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:07 devstack sudo[90947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:12:07 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:08 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:08 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-89d5bed2-61eb-4c64-b4b8-666533a3d58f tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.437s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:08 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-89d5bed2-61eb-4c64-b4b8-666533a3d58f tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:08 devstack cinder-volume[82683]: INFO cinder.volume.manager [None req-89d5bed2-61eb-4c64-b4b8-666533a3d58f tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Deleted volume successfully. Feb 27 02:12:08 devstack cinder-volume[82683]: DEBUG cinder.coordination [None req-89d5bed2-61eb-4c64-b4b8-666533a3d58f tempest-CreateVolumesFromSourceVolumeTest-1308695343 None] Lock "cinder-d691cbad-31f3-4c40-aaa9-8f760c9d2110-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=82683) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 27 02:12:09 devstack cinder-volume[82683]: DEBUG oslo_service.periodic_task [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82683) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 27 02:12:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 27 02:12:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 27 02:12:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3': None} {{(pid=82683) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 27 02:12:09 devstack cinder-volume[82683]: DEBUG cinder.volume.drivers.quobyte [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-67098a06-9af5-4eb1-adcd-6cbfa164c0d3'] {{(pid=82683) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 27 02:12:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.lockutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82683) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 27 02:12:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 27 02:12:09 devstack sudo[90991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb Feb 27 02:12:09 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 27 02:12:09 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root Feb 27 02:12:09 devstack cinder-volume[82683]: DEBUG oslo_concurrency.processutils [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/08c67af37dfc5bc309e4f9829f373bcb" returned: 0 in 0.452s {{(pid=82683) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 27 02:12:09 devstack cinder-volume[82683]: DEBUG cinder.manager [None req-b09dae30-4d67-4c65-9ab6-f816dd53f164 None None] Notifying Schedulers of capabilities ... {{(pid=82683) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 27 02:12:17 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:UPDATE=86,cinder:DELETE=10,cinder:SELECT=52,cinder:INSERT=15 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 27 02:12:18 devstack cinder-volume[82683]: DEBUG dbcounter [-] [82683] Writing DB stats cinder:SELECT=56,cinder:UPDATE=89,cinder:DELETE=5,cinder:INSERT=26 {{(pid=82683) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}